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G-INVARIANT HOLOMORPHIC MORSE INEQUALITIES 


MARTIN PUCHOL 


Abstract. Consider an action of a connected compact Lie group on a compact complex 
manifold M, and two equivariant vector bundles L and E on M, with L of rank 1. The 
purpose of this paper is to establish holomorphic Morse inequalities a la Demailly for the 
invariant part of the Dolbeault cohomology of tensor powers of L twisted by E. To do so, 
we define a moment map fi by the Kostant formula and we define the reduction of M under 
a natural hypothesis on /x -1 (0). Our inequalities are given in term of the curvature of the 
bundle induced by L on this reduction. 
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0. Introduction 

Morse Theory investigates the topological information carried by Morse functions on a mani¬ 
fold and in particular their critical points. Let / be a Morse function on a compact manifold of 
real dimension n. We suppose that / has isolated critical points. Let rrij, (0 < j < n) be the the 
number of critical points of / of Morse index j, and let bj be the Betti numbers of the manifold. 
Then the strong Morse inequalities states that for 0 < q < n, 

(0.1) E(-^ 

j-0 j =o 

with equality if q = n. From m, we get the weak Morse inequalities: 

(0.2) bj < rrij for 0 < j < n. 
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In his seminal paper [2?i , Witten gave an analytic proof of the Morse inequalities by analyzing 
the spectrum of the Schrodinger operator A t = A + t 2 \df\ 2 + tV, where t > 0 is a real parameter 
and V an operator of order 0. For t +oo, Witten shows that the spectrum of A t approaches 
in some sense the spectrum of a sum of harmonic oscillators attached to the critical point of /. 

In [7], Demailly established analogous asymptotic Morse inequalities for the Dolbeault coho¬ 
mology associated with high tensor powers L p := L® p of a holomorphic Hermitian line bundle 
( L : h L ) over a compact complex manifold (M, J). The inequalities of Demailly give asymp¬ 
totic bounds on the Morse sums of the Betti numbers of d on L p in terms of certain inte¬ 
grals of the Chern curvature R L of ( L,h L ). More precisely, we define R L £ End(T^ 1,0 ^Af) by 
g™ (R L u,v) = R l (u,v ) for u,v £ T^ 1,0 ^M, where g™ is a J-invariant Riemannian metric on 
TM. We denote by M(< q) the set of points where R L is non-degenerate and have at most q 
negative eigenvalues, and we set n = dime M. Then we have for 0 < q < n 

(0.3) ^(-l)^dim W(M,L p )<^-[ (-1 y(^E± R A +0 (p n ), 

^ n! J M (< q ) V 2tt J 


with equality if q = n. Here H^(M,L P ) denotes the Dolbeault cohomology in bidegree (0, j), 
which is also the j-th group of cohomology of the sheaf of holomorphic sections of L p . 

These inequalities have found numerous applications. In particular, Demailly used them in 
[7] to find new geometric characterizations of Moishezon spaces, which improve Siu’s solution 
in JBJ [19] of the Grauert-Riemenschneider conjecture m- Another notable application of the 
holomorphic Morse inequalities is the proof of the effective Matsusaka theorem by Siu mm- 
Recently, Demailly used these inequalities in m to prove a significant step of a generalized 
version of the Green-Griffiths-Lang conjecture. 

To prove these inequalities, the key remark of Demailly was that in the formula for the Kodaira 
Laplacian D p associated with L p , the metric of L plays formally the role of the Morse function 
in the paper Witten [23], and that the parameter p plays the role of the parameter t. Then the 
Hessian of the Morse function becomes the curvature of the bundle. The proof of Demailly was 
based on the study of the semi-classical behavior as p —> +oo of the spectral counting functions 
of Dp. Subsequently, Bismut gave an other proof of the holomorphic Morse inequalities in 0 by 
adapting his heat kernel proof of the Morse inequality [T . The key point is that we can compare 
the left hand side of m with the alternate trace of the heat kernel acting on forms of degree 
< q, i-e., 


(0.4) 


HUM, L p ) < Tr n °’ j{M ’ LP) 


o =o 


3=0 



--a 



with equality if q = n. Then, Bismut obtained the holomorphic Morse inequalities by showing 
the convergence of the heat kernel thanks to probability theory. Demailly [5] and Bouche (5) 
gave an analytic approach of this result. In m , Ma and Marinescu gave a new proof of this 
convergence, replacing the probabilistic arguments of Bismut [2] by arguments inspired by the 
analytic localization techniques of Bismut-Lebeau [4] Chap. 11]. 

When the bundle L is positive, (10.31) is a consequence of the Hirzebruch-Riemann-Roch theo¬ 
rem and of the Kodaira vanishing theorem, and reduces to 

(0.5) dim H\M,L p ) = ^( {^R L ) n + o(p"). 

n\ J M 2tt 

In this case, a local estimate can be obtained by the study of the asymptotic of the Bergman 
kernel (the kernel of the orthogonal projection from L p ) onto H°(M, L p )) whenp —> +oo. 

We refer to m and the reference therein for the study of the Bergman kernel. 
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In the equivariant case, a connected compact Lie group G acts on M and its action lifts on 
L. When L is positive, Ma and Zhang m have studied the invariant Bergman kernel, i.e., the 
kernel of the projection from L p ) onto the G-invariant part of H°(M, L p ). Let p, be the 

moment map associated with the G-action on M (see (10.71) 1. Ma and Zhang jl6] established 
that the invariant Bergman kernel concentrate to any neighborhood U of /i _1 (0), and that near 
/i -1 (0), we have a full off-diagonal asymptotic development. They also obtain a fast decay of 
the invariant Bergman kernel in the normal directions to /x _1 (0), which does not appear in the 
classical case. 

In this paper, we establish G-invariant holomorphic Morse inequalities under certain natural 
condition, in the context of Ma-Zhang [T6] but without the assumption that L is positive. 

More precisely, we consider an action of a connected compact Lie group G on a compact 
complex manifold M and two G-equivariant vector bundles L and E on M, with L of rank 1, 
and we establish asymptotic holomorphic Morse inequalities similar to m for the G-invariant 
part of the Dolbeault cohomology of L p <g) E (see Theorems 10,31 and 10.51) . To do so, we define a 
“moment map” ji\ M —> Lie(G) by the Kostant formula and we define the reduction of M under 
natural hypothesis on /i -1 (0) (see Assumption 10.11) . Our inequalities are then given in term of 
the curvature of the bundle induced by L on this reduction, and the integral in (10.31) will be over 
subsets of the reduction. 

A new feature in our setting when compared to Demailly’s result is the localization near 
/i -1 (0). We use a heat kernel method inspired by [23 (see also T5 S Sect. 1.6-1.7]), the key being 
that an analogue of flop still holds (see Theorem ED for the Kodaira Laplacian restricted to 
the space of invariant forms. We show that the heat kernel will concentrate in any neighborhood 
U of /i -1 (0), and we study the asymptotic of the heat kernel near /i -1 (0). For this last part, 
we work with the operator induced by the Kodaira Laplacian on the quotient of U. However, 
as we will have to integrate the heat kernel in the normal directions to /U _1 (0), we need a more 
precise convergence result that in usi Sect. 1.6]. Indeed we also need to prove a uniform fast 
decay of the heat kernel in the normal directions, which is analogous to the decay encountered 
in [M Thm. 0.2]. Our approach is largely inspired by )f6j . 

Note that in the literature, there exists another type of equivariant holomorphic Morse in¬ 
equalities El El ESI, which relate the Dolbeault cohomology groups of the fixed point-set of a 
compact Kahler manifold M endowed with an action of a compact connected Lie group G to the 
Dolbeault cohomology groups of M itself. 

We now give more details about our results. Let (M, J) be a connected compact complex 
manifold. Let n = dime M. Let (L , h L ) be a holomorphic Hermitian line bundle on M, and 
(E,h E ) a holomorphic Hermitian vector bundle on M. We denote the Chern (i.e., holomorphic 
and Hermitian) connections of L and E respectively by V s and V s , and their respective cur¬ 
vatures by R l = (V L ) 2 and R E = (V s ) 2 . Let u> be the first Chern form of ( L,h L ), i.e., the 
(1, l)-form defined by 


( 0 . 6 ) 


U) = 


dL 


2-7T 


R. 


We do not assume that w is a positive (1, l)-form. 

Let G be a connected compact Lie group with Lie algebra g. Let d = dim® G. We assume 
that G acts holomorphically on (M, J ), and that the action lifts to a holomorphic action on L 
and E. We assume that h L and h E are preserved by the G-action. Then R L , R E and uj are 
G-invariant forms. 

In the sequel, if F is any G-representation, we denote by F G the space of elements of F 
invariant under the action of G. The infinitesimal action of K £ g on any F will be denoted by 
Cf <: or simply by Ck when it entails no confusion. 
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For A' g g, let K M be the vector field on M induced by K (see (11.21) 1. We can define a map 
fi: M g* by the Kostant formula 

(0-7) ii(K) = (V^m - C K ) ■ 

Then for any K £ g (see Lemma EH, 

(0.8) dp(K) = i K MU}. 

Moreover the set defined by 

(0.9) P = H~\ 0) 

is stable by G. 

We make the following assumption: 

Assumption 0.1. 0 is a regular value of p. 

Under Assumption 10.11 P is a submanifold. Moreover, by Lemma 12.21 G acts locally freely 
on P, so that the quotient Mq = P/G is an orbifold, which we call the reduction of M. For 
definition and basic properties of orbifolds, we refer to [15t Sect. 5.4] for instance. The projection 
P —> Mq is denoted by i r. 

We denote by TY the tangent bundle of the G-orbits in P. As G acts locally freely on P, we 
know that TY = Span(A' M , K £ g) and that it is a vector bundle on P. 

The following analogue of the classical Kahler reduction (see m) holds. 

Theorem 0.2. The complex structure J on M induces a complex structure Jq on Mq, for 
which the orbifold bundles Lq,Eg induced by L,E on Mg are holomorphic. Moreover, the form 
oj descends to a form ujg on Mq and if R Lg is the Chern curvature of Lq for the metric h La 
induced by h L , then 

(0.10) w G = ^P io . 

Z7T 

Finally, for x £ Mq, 7r* induces an isomorphism 

(0.11) (ker log)x ^ (kerw)^-!^). 

Let b L be the bilinear form on TM 

( 0 . 12 ) = 

Then we will show in Lemma 12.31 that when restricted to TY x TY, the bilinear form b L is 
non-degenerate on P. In particular, the signature of 6 l |ttxT'k is constant on P. We denote by 
(r,d— r) this signature, i.e., in any orthogonal (with respect to b L ) basis of TY\p, the matrix of 
b L will have r negative diagonal elements and d — r positive diagonal elements. 

We define R Lg £ End (T^ 1,0 ^Mq) by g(R Lc u,v) = R Lg (u,v) for u, v £ T^’^Mq, where g is 
a J G -invariant Riemannian metric on the orbifold tangent bundle TMq- We denote by M G (g) 
the set of x £ Mq such that Rff G is invertible and has exactly q negative eigenvalues, with the 
convention that if q ^ {0,... ,n — d}, then Mc{q) = 0- Set M G (< q) = U i< q Mc{i)- Note that 
Mc(q) does not depend on the metric g. 

As G preserves every structure we are given, it acts naturally on the Dolbeault cohomology 
H*(M, L p <g) E). The following theorem is the main result of our paper. 
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Theorem 0.3. Assume that G acts effectively on M (i.e., the only element of G acting as IcIm 
is the identity). Then as p —>■ +oo, the following strong Morse inequalities hold for q £ {1,..., n} 

q -n-d r 

(0.13) dim Hi (M, L*> ® Ef <rk(E)/—- / (-1)^^ + o(p n ~ d ), 

yn - J M G (<g-r) 

with equality for q = n. 

In particular, we get the weak Morse inequalities 

n-d /• 

(0.14) dim H q (M,L p 0 E)° < rk {E) T / (-l)' ? - r wg" d + o(p n ~ d ). 

[n d). J Mcdg—r) 

Remark 0.4. We assume temporarily that G acts freely on P, so that Mq is a manifold. 

If L is positive, then uj is a Kahler form and /r is a genuine moment map. Moreover, [Mg, wig) 
is the usual Kahler reduction of M (see mi). Zhang m Theorem 1.1 and Proposition 1.2] 
proved that in this case quantization and reduction commute: for p large enough, 

(0.15) H % (M,L P ®E) G ~ H°(M g , Lq 0 E g ). 

We refer to Vergne’s Bourbaki seminar [22] for a survey on the Guillemin-Sternberg geometric 
quantization conjecture. 

In particular, as in the non equivariant setting, Theorem 10.31 is, in this case, a consequence 
of (10.1511 and of the Hirzebruch-Riemann-Roch theorem and of the Kodaira vanishing theorem, 
both applied on Mq- 

We prove here that even if to is degenerate or if G does not act freely on P, under Assump¬ 
tion nm we have the same estimate for ^® =Q (—l) 9 J dim IP (M, L p 0 E) G as the one given by 
the holomorphic Morse inequalities on Mq for g(—l) 9- ! dim H :1 (Mg, L p g ® Eg). 

Theorem 10.31 is in fact a particular case of the more general Theorem 10.51 below. 

Set 

(0.16) G° = {g € G : g ■ x = x for any x € M }, 

which is a finite normal subgroup of G. Note that we will see in (15.2311 that we also have 
G° = {g £ G : g ■ x = x for any x £ P}. 

Observe that dim(P(] ® E V ) G does not depend on«€ M. We will thus denote it simply by 
dim(L p ® E) g ° . 

Theorem 0.5. As p —> +oo, the following strong Morse inequalities hold for q £ {1,..., n} 


(0.17) ^(-l) 9 " J dim W(M,L p ®E) g 

i=o 

n n-d r 

< dim (LP 0 E) g / (-1 y~^ n G ~ d + o(p n ~ d ), 

(n-d)] J MG (<q-r) 


with equality for q = n. 

In particular, we get the weak Morse inequalities 

jjn—d r 

(0.18) dim H g (M, L p 0 E) G < dim(I7 0 E) G -— / {-iy~ r u]M d + o(p n ~ d ). 

[n - d)\ J Ma{q _ r) 


Remark 0.6. The integer dim(L p 0 E) G ° depends on p. However, as G° is finite and acts by 
rotations on L, there exists k £ N (a divisor of the cardinal of G°) such that G° acts trivially on 
L k . In particular, we have dim(L fcp 0 E) G = dimP G . 
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We now explain what are the main steps of our proof. 

Let g™ be a J- and G-invariant metric on TM. Let di>M be the corresponding Riemannian 
volume on M, and let V™ be the Levi-Civita connection on (TM, g™). Let & LV ® E be the 
Dolbeault operator acting on f l 0 , *(M,L p g E). Let <9 lP ® e >* be its dual with respect to the L 2 
product induced by g™, h L and h E on Q°’*(M,L P g E). We set 

(0.19) D p = V2 (b lp ® e + d LP ® E ’*^ , 

— n 2 

and we denote by e p the associated heat kernel. 

We denote Pq the orthogonal projection from Q°’*(M,L P g E) onto f l°'*(M,L p g E) G . Let 
(Pce~p p Pg)(v,v') be the Schwartz kernel of Pgc~ p p Pq with respect to cIvm(v')- 

Note that the operator D ^ acts on £l°’ m (M, L P ®E) G (i.e., commutes with Pq) and preserves the 

Z-grading. we denote by Tr q [PGe~ pDp Pq] the trace of Pae~ pDp PG acting on Q°’ q (M, L p g E). 
We then have an analogue of (10.41) : 


Theorem 0.7. For any u > 0, p £ N* and 0 < q < n, we have 

9 9 

(0.20) ^(-l) 9 “ J dimP J '(M,P p gP) G < 5^(-1 )«-*'Ttj- [P G e~ pDp P G \, 

3=0 j=0 

with equality for q = n. 

— 2L n 2 

We now give the estimates on PGe~ p p Pc to treat the right-hand side of (10.201) . 

Let U be a small open G-invariant neighborhood of P, such that G acts locally freely on its 
closure U. 

First, we have away from P the following theorem. The analogous result of Ma-Zhang for the 
invariant Bergman kernel is [H Thin. 0.1]. 


Theorem 0.8. For any fixed u > 0 and k,£ £ N, there exists C > 0 such that for any p £ N* 
and v, v' £ M with v, v' £ M \ U, 


( 0 . 21 ) 


P G e p Up Pg(v,v') 


< Cp 


—k 


where \ ■ \<gi is the to^-norm induced by V L , V E , V™, h L , h E and g 


TM 


We now turn to the “near P” asymptotic of the heat kernel. To explain simply this asymptotic, 
we assume now that G acts freely on P. We can thus also assume that G acts freely on U . Let 
B = U/G. Then Mq and B are here genuine manifolds. We will explain in Section l54?l how to 
adapt the proof of Theorems 10.31 and 10.51 to the case of a locally free action. 

We again denote by TY = Span(/f M ,A' £ g) the tangent bundle of the orbits in U. By 
Lemma E31 we have 

(0.22) TU = TY © (TY)- 1 ^ . 

Then we can choose the horizontal bundles of the fibrations U —> B and P —> Mg to be 
respectively 

(0.23) T h U = (TY) ± ’> L and T H P = T H U\ p D TP. 

Indeed, using (10.221) and the fact that TY C TP, we see that 

(0.24) TP = TY © T h P. 

Let g T p be a G-invariant and J-invariant metric on T H P. Let g T ^ be a G-invariant metric 
on TY and let g JTY be the G-invariant metric on JTY induced by J and g Ty . Then by (12.191) . 
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T P 


we can chose the metric g™ on TM so that on P: 

(0.25) 9™\p=9 TY \p®9 JTY \p®r 

We will use this condition on g™ in the rest of the introduction as well as in Sections 14.1115.21 
Suppose that U is small enough so that it can be identified with a e-neighborhood, e > 0, 
of the zero section of the normal bundle IV of P in U via exponential map. We denote the 
corresponding coordinate by v = {y.Z^-) £ U with y £ P and Z 1 - £ N y . Note that by (10.241) 
and (10.251) we can identify N y and JTY y . 

Let J £ End(TM|p) be such that on P 

(0.26) w = g™(3-,-). 


By (14.51) . the normal bundle Nq of Mq in B can be identified with the bundle ( JTY)b induced 
on B by JTY ~ N (see Section [TJ. In particular, if 7r (y) = x, we keep the same notation for an 
element of N y and the corresponding element in Nc t x- 

We will see in Section 14.31 that J intertwines the bundles TY and JTY. In particular, J 2 
induces an endomorphism of Nq and if {a] 1 ,... ,a^} = — 2v / ^l7rSp(J|( T ^0j r y)(i,o)) (aj~ £ R*), 
then 

(0.27) Sp(J 2 U G ) = -^rK’ 2 ,... ,aj’ 2 }. 

Let g TB be the metric on TB induced by g™ and T H P. Let g Nc be the induced metric on 
Nq and dvN G the corresponding volume form. For x £ Mq, let {e B }f =1 be an orthonormal basis 
of Ng,x such that J 2 e^- = — 4^2 a i 2 { x ) e t- We can then identify with Ng, x via the map 


d 

(0.28) (Z B ,...,Z B )eR d ^Z ± = J 2 Z B ei. 

2=1 

We now define the operator acting on Nq, x — R d by 

(0-29) Jfj- =-J2 (( v e£) 2 - \ a t z i~\ 2 ) 

i = 1 * 7=1 

where Vu denotes the ordinary differentiation operator on R. d in the direction U. We denote 
by e~ u ^ x {Z^-^Z'^) the heat kernel of with respect to dvN GiX {Z ,J -). Note that we have 
an explicit formula for e~ uB£ * (Z ± ,Z' ± ) (see (15.121) 1. but we do not give it to have a simpler 
asymptotic formula for the heat kernel. 

Let g™ G be the metric on Mq induced by g™ and T H P and dvM G the corresponding 
volume form. We denote by {• ,-)g the C-bilinear extension of g™ G on TMq < 8 > C. Then we can 
identify R L ° with the Hermitian matrix R Lg £ End(Tl 1,0 lM(j) such that for V,V' £ T^ 1 , 0 ^Mg, 

(0.30) R Lg {V,V') = (R Lg V,V 7 ) G - 

Let {wj} be a local orthonormal frame of T^ 1,0 ^M with dual frame {w 7 }. Set 
(0.31) uj d = ~ y~] R L (wj,Wj)w J A i Wi . 

Let h be the G -invariant smooth function on M given by (see Section [TJ 
(0.32) h{x) = i/vol (G.x), 

and let k £ < ^ 00 (TB|m g ) be the function defined by k\m g = 1 and for x £ Mq, Z £ T X B , 

(0.33) dvB{x,Z ) = k{x, Z)dv TxB (Z) = k(x, Z)dvM a ( x )dvN GiX (Z). 

The following result is a version of m Thm. 2.21] in our situation for the heat kernel. 
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Theorem 0.9. Assume that G acts freely on P. For any fixed u > 0 and m £ N, we have the 
following convergence as p —>■ +oo for \Z ± \ < e: 


(0.34) h(y, Z J -) 2 (P G e-f D 'P G )((y,Z- L ), (y, Z x )) = 
ft -1 (a;, Z B ) det (R^ G )e 2uuid ^ u3 ,± 


( s /pZ ± , y /pZ ± )®ld E p n - d/2 


(2n) n ~ d det(l-exp(-2 uR B g )) 

+ o(p" _d / 2_1 / 2 (i + ^|z- L |)- m ), 

where x = ir(y) £ Mg and the term O(-) is uniform. The convergence is in the ff 00 -topology in 
y £ P. Here, we use the convention that if an eigenvalue of R F o G is zero, then its contribution 


to 


det(R° ) 


det (l—exp (—uRxg )) 


From Theorems 10.71 liTEl and ItHJl we get Theorem 10.31 in the case where G acts freely on P by 
integrating on M the trace of (P^e - p Dp Pc) (to, m), then taking the limit u —> +oo. 

This paper is organized as follows. In Section U) we recall some constructions associated with 
a principal bundle. In Section [2] we apply the constructions and results of Section [T] to our 
situation to define the reduction of M and to descend the different objects we are given on it, 
thus proving Theorem 10.21 In Section [3] we prove the localization of the heat kernel near P, 
i.e., Theorem 10.81 In Sections |U we assume for simplicity that G acts freely on P and U, and 
study the asymptotic of the heat kernel near P by localizing the problem and studying a rescaled 
Laplacian on B. We thus obtain Theorem 10.91 Finally, in Section [5l we prove the G-invariant 
holomorphic Morse inequalities (Theorems 10.31 and 10.511 and we also show how to use Theorem 
10.51 to get estimates on the other isotypic components of the cohomology H*(M,L P ® E). 


1. Connections and Laplacians associated with a principal bundle 


In this section, we review some results of Ha Chp. 1] for the convenience of the reader. 

Let G be a connected compact Lie group of dimension d that acts smoothly and locally freely 
on the left on a smooth manifold M of dimension m. Then tt: M —> B = M/G is & G -principal 
bundle and B is an orbifold. We denote by TY the relative tangent bundle of this hbration. 

Note that in Chp. 1], Ma and Zhang assumed that G acts freely on M, but as they 
explain in the introduction of [TBJ Chp. 1] and in [El Sect. 4.1], the results of [El Chp. 1] 
extend to the case where G acts only locally freely, essentially because when we work on orbifold 
quotients, we in fact work with invariant sections on M. 

Let g™ be a G-invariant metric on TM , and V™ the corresponding Levi-Civita connection 
on TM. We denote by T H M the orthogonal complement of TY in TM. For U £ TB, we denote 
by U H the horizontal lift of U in TM, that is 7 t*U h = U and U H £ T H M. Let 6: TM —¥ g be 
the connection form corresponding to T H M , and let 0 be its curvature, i.e., the horizontal form 
such that 


(1.1) Q(U h , V H ) = -P TY [U H , V H ], 

where P Ti is the natural projection TM = TY © T H M — > TY. 

The metric g™ induces a metric g TY (resp. g T M ) on TY (resp. T H M ). Let g TB be the 
metric on TB induced by g T M , and let V TS be the corresponding Levi-Civita connection. 

Let ( F,h F ) be a G-equivariant Hermitian vector bundle with G-equivariant Hermitian con¬ 
nection V F . Then G acts on < ^’ 00 (M, F) by ( g.s)(x ) = g.s(g~ 1 x). 

Any K £ q induces a vector field K M on M given by 


( 1 . 2 ) 


s=0 
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For I\ £ g, recall that Ck is the infinitesimal action of I\ on any G representation. Let g F £ 
‘if 00 (M, g* <g> End(F)) be defined by 

(1.3) g F (K) = V f m -C k . 

Using the identification TY ~ M x g, we can identify g F with J1 F £ ( ^’°°(M,TY ® End(F)) G 
such that 

(1.4) (Jl F ,K M )=g F (K). 

Let Fb be the orbifold bundle on B induced by F, i.e., Fb, x = c &°° {n~ l {x) , F| w -i( x )) G . Then 
there is a canonical isomorphism 

(1.5) ttg : < if 00 (M, F) g ^4 < &°°{B, F B ). 

The invariant metric h F induces a metric h FB on Fb- For s £ (B, Fb) and U £ TB, we 

define 

(1.6) V Fb s:=V f h s. 

Observe that V Fs is the restriction of the connection V F — g(6) to c tf co (M, F) G . Let R Fb be 
the curvature of V Fs . Then by [TB] (1.18)] we have for V,V' £TB 

(1.7) R Fb {V,V') = R f (V h ,V' h )- h f (Q)(V,V'). 

Let dvM be the Riemannian volume on (M,g™). We endow < ^’ 00 (M, F) with the L 2 product 
induced by g TAI and h F : 

(1.8) (s,s')= / (s, s’) h F{x)dv M {x). 

J M 

In the same way, g TB and h FB induce a L 2 product (•, •) on < ^’ 00 ( B , Fb). 

For x £ M, we denote by vol(G.x) the volume of the orbit of G.x endowed with the restriction 
of g TAI . Define the G-invariant function h on M by 

(1.9) h(x) = y/vol(G.x). 

Then h define a function on B, which is still denoted by h. Note that h is smooth only on the 
regular part of B. However, we can extend it continuously to get a smooth function h on B. 
Then h also define a smooth function on U. 

The map 

(1.10) $:=£tt g : (<e°°(M,F) G , (■,■)) -> (V°°(B,F b ), <•,•)) 
is then an isometry. 

Let be an orthonormal frame of TM. For any Hermitian bundle with Hermitian 

connection (E, h E , V F ) on M, the Boclmer Laplacians A E , A m are given by 

m 

(l-H) A E = -E(( V ") 2 -^ fui ) , Am = A c . 

i=l 

Let {/z}f = ibe a G-invariant orthonormal frame of TY with dual frame {/*}f =1 , and let {ei}”U[ d 
be an ortho normal frame of TB. Then {e B , fi} form an orthonormal frame of TM. 

For < 7 , a' £ TY <g» End(F), let (a, a') g TY £ End(F) be the contraction of the part of a (g> a' in 
TY ® TY with g TY . Note that 

d 

(jl F ,Jl F ) g TY = ^2(p. F , fif g TY £ End(F). 

1=1 


( 1 . 12 ) 
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Theorem 1.1. As an operator on ff 00 (B, Fb), &A f & 1 is given by 
(1.13) = A Fb - {Jl F Ji F ) g TY - h- 1 A B h. 

Proof. This is proved in [TB] Thm. 1.3]. □ 

2. The reduction of M and the Laplacian on B 

This Section is organized as follows. In Section 12.11 we apply the constructions and results 
of Section [T| to our situation in order to define the reduction of M and to descend the different 
objects we are given on it. We prove, under Assumption 10.11 some properties of the reduction 
that are well-known in the case where oj is positive and get Theorem 10.21 In Section 12.21 we 
compute the operator induced on U/G by the Kodaira Laplacian. 

We use here the notations of the introduction. In particular, let (M , J) be a connected compact 
complex manifold of dimension n, let (L, h L ) be a holomorphic Hermitian line bundle on M and 
(E,h E ) a Hermitian complex vector bundle on M. We denote the associated Chern curvatures 
by R l and R E . Let w = -^f-R L be the first Chern form of ( L,h L ), which is not assumed to 
be positive. Let G be a connected compact Lie group with Lie algebra g. Let d = dirng G. We 
assume that G acts holomorphically on (M, J ), and that the action lifts in a holomorphic action 
on L and E. We assume that h L and h E are preserved by the G-action. 

Recall that V L denotes the Chern connection of (L, h L ) and that the moment map p is defined 
by 2iirp(K) = V^. M — Ck for K G g. Let P = p~ 1 (0) and U a small tubular neighborhood of P. 
Finally, we set Mq = P/G. 

2.1. The reduction of M. We begin by proving the following result. 

Lemma 2.1. The map p is smooth on M and is linear in K. Moreover, it is moment map of 
the G-action on M, i.e., p is G-equivariant and for any K £ g, 

(2.1) dp(K) = 

Proof. First, as both V^- M and jOk satisfies the Leibniz rules and preserves h L , we know that 
V£, m — Ck is ^’°°(M)-linear, and moreover it is a skew-adjoint operator. Thus, under the 
canonical isomorphism End(L) = C, 

(2.2) X/ l kM - C K S Sf°°(M,fR). 

This proves the first part of Lemma 12.11 

As V L is G-invariant, we have g ■ (V£s) = V^ Y (9 ' s ) for Y e ^), s e 
and g £ G. Thus, taking g = e~ tK for K £ g and differentiating at t = 0, we get 

(2.3) TA'VyS = V^-m yjs + VyA/fS, that is [£a-,V l ] = 0. 

Using the definition of g dm m becomes 

(2.4) (2inn(K) + V^;)VyS = V^-MyjS + Vy (2infj,{K) + V I f cM )s. 

This, together with dm, yields to 

(2.5) Y(p(K))=u(K M ,Y), 
which is m 

Finally, it is easy to prove that g*K M = (Ad g K) M and g ■ ( Cks) = C^dgK^g ■ s), so 
( 2 -6) 2mg ■ {,p{K)s ) = (Vf Adfl ^ )M - C AdgK ){g ■ s), 

and thus 
(2.7) 


p(g x x) = Ad*-i/i. 
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The proof of Lemma HOI is complete. □ 

Lemma 2.2. The group G acts locally freely on P. 

Proof. By (12.11) . we have for x £ P, V £ T X M and K £ g, 

(2.8) oj(K m ,V) x = (d x »(V))(K). 

In particular, if K M = 0, then ( d x p,(V))(K ) vanishes for all V G T X M. However, by Assump¬ 
tion urn the differential d x fi: T X M —> g* is surjective, hence K = 0. □ 

Lemma 2.3. When restricted to TY x TY, the bilinear form b L is non-degenerate on P. 

Proof. First, observe that for x G P, V £ T X M and K G g, equations (10.121) and (12.11) yield 

(2.9) b L (K M , JV) X = -oj(K m , V) x = - (d xt i(V)) (K). 

Let x £ P, V G T X M and K £ g. Then by (12.91) 

(2.10) JUG (TY) ± » L \ p d x fi(V)= 0 «=> VeTP, 

the last equivalence coming from the fact that P = /r _1 (0). In particular, dim(TY')- L i>- L = 
dim TP = 2 n — d, the last identity coming from the fact that 0 is a regular value of //. Moreover, 
dim TY = d (because G acts locally freely on U) and TY + (TY) J ~b L = TU. This is possible 
only if this sum is direct, i.e., TY D (TY)- l i> l = {0}. We have proved our lemma. □ 

By Lemma 12.31 we have 

(2.11) TU = TY ® (TY) 1 *’ 1, . 

Then we can choose the horizontal bundles of the fibrations U —> B and P —>■ Mg to be 

(2.12) T h U = ( TY )- L ^ and T H P = T H U\ p D TP. 

Indeed, using (12.111) and the fact that TY C TP, we see that 

(2.13) TP = TY © T h P. 

Let (Lg, h L °, V L °) and (Eg, h Ea , V E °) be defined from ( L,h L .S7 L ), (E, h E , V E ) and T H P 
as indicated in Section [TJ We also define ojq by 

(2.14) w G (y,V')=u{V H ,V H )- 

Note that EJ restricted to P = p 1 (0) gives 

(2.15) R Lb \m g (V,V') =R l \ p (V h ,V' h ). 

From (10.61) . (12.141) and (12.151) . we see that if R Lg is the curvature of V ic , then 

(2.16) uj G = ^-R Lg . 

Z7T 

Lemma 2.4. We have 

T h U\ „ = JTP 

(2.17) , lp 

TU\p = TP © JTY. 

In the second line, the sum is orthogonal with respect to b L . 

Proof. Recall that T H U = (TY) 1 ->> L . Thus the first identity in (12.171) follows from (12.101) . 
Concerning the second, we have for V £ TP and K G g, 

(2.18) b L (JK M ,V) x = uj(K m , V) x = (d x n(V)) x (K) = 0. 

Using (12.181) and the facts that b L is non-degenerate on JTY and that dim TU = dim TP 
dim JTY, we get the second identity in (12.171) . 


□ + 
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Using Lemma 12.41 and (12. 1311 , we find firstly 

(2.19) TXJ\p = T h P © TY ® JTY, 

the decomposition being orthogonal for b L , and secondly by Lemma f7~i1 and (12.1211 . 

(2.20) T h P = TP n JTP. 

In particular, T H P is stable by J, so we can define an almost-complex structure on M G in the 
following way. For V £ TMq, we denote V H its lift in T H P 1 and we define the almost complex 
structure J G on M G by 

(2.21) ( J G V) h = J(V H ). 

Lemma 2.5. The almost complex structure J G is integrable, thus (Mq , J G ) is a complex mani¬ 
fold. 

Proof. Let u,v £ ^ oo (M G ,T 1 ’ 0 M G ). Then there are U, V £ ^°°{Mg,TM g ) such that 

(2.22) u = U- V^IJgU , v = V - V^IJgV. 

Using (12.211) . we find 

(2.23) u H = U H - V~IJU H , v = V H - V^1JV H £ T lfi M n T C P. 

As both T 1,0 M and TcP are integrable, we have [u H ,v H ] £ T 1,0 M D TqP, i.e., there is W £ 
^°°(M,TM) such that 

(2.24) [u H , v H ]=W - \f~-YJW, 

and moreover W, JW £ TP. Thus, W £ TP (~l JTP = T H P and we can write W = X H for X a 
section of TMq- Hence 

(2.25) [u,v] = tt4u h ,v h ] = 7r*(X ff - V=1JX H ) = X- V^1J G X £ T 1,0 M G . 

By the Newlander-Nirenberg theorem, (12.251) means that J G is integrable. □ 

Lemma 2.6. The bundles Lq and Eq are holomorphic. Moreover, V Lg and X E ° are the 
respective Chern connections of (La, h La ) and ( Ec,h EG ). 

Proof. We first prove the result for Lq- 
Observe that for 17, V £ TMq , 

(2.26) w G ( J G U, J G V) = oj(JU h , JV H ) = u){U H , V H ) = w G (f/, V). 

Hence, w G is a (1, l)-form, and so is R Lg by (12.161) . We decompose V Lg into holomorphic part 
and anti-holomorphic part, 

(2.27) V iG = (V iG ) 1,0 + (V iG ) 0,1 . 

As R Lg is (1,1), we have 

(2.28) ((V LG ) oa ) 2 = 0. 

For s £ c €°°{M g, Lq), we define 

(2.29) 5 Lg s = {X Lg )°’ 1 s. 

Let so be a local frame of Lq near Xg £ M G . Then we can write (V Lg ) 0,1 so = aso for some 
(0, l)-form a. By (12.281) . we have 


(2.30) 


0 = ((V Lg )°’ 1 ) 2 s 0 = ( da)s 0 . 
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Thus, da = 0. By the (local) 9-lemma, there is a function / defined near Xq such that df = —a. 
Thus, 

(2.31) B Lg s 0 + {Bf)s o = 0. 

This shows that (12.29[) defines a holomorphic structure on Lq, for wich e ?sq is a local holomorphic 
frame near Xq. 

Finally, \/ L ° is clearly Hermitian with respect to h Lc , and is holomorphic by the definition 
(12.2911 . so V Lg is indeed the Cliern connection on Lq- 

We now turn to Eq. Here again, it is enough to prove that R E ° is a (1, l)-form (see for 
instance [121, Prop. 1.3.7]). As R E is a (1, l)-form, (11.71) shows that it is equivalent to prove that 
0| r pHp^ r j'Hp is a (1, l)-form. 

Let u = U — \f—YJU and v = V — y/^lJV be in ( T H P ) 1,0 . As U, V, JU and JV are in 
T H P = TP fl JTP and TP is integrable, we have [it,u] £ TcP. Moreover, as u and v are of 
type (1,0) and J is integrable, [u,t>] is also of type (1,0), and thus [u,v\ = —iJ[u,v] £ JTcP. In 
conclusion, [u,v] £ T E P and by (11.11) . Q(u,v) = 0. □ 

Lemma 2.7. We have ker oj\ p C T H P , and for x £ Mq, tl* induces an isomorphism 

(2.32) (ker u>g)x — (ker w)| OT -i (x ). 

Proof. Let V £ TU\p be such that uj(V,-) = 0. Then we also have b L (V,-) = 0. Thus V is in 
particular in {TY) ± bL = T H U. Moreover, V is also orthogonal (for b L ) to JTY ', so is in T H P 
by Lemma HTTl 

As u>g {tjv , 7T*-) = w(-, •), we know that 7r* maps kerwjp in kerwc, and is injective as ker uj\p C 
T h P. Finally, if V £ ker uiq, then oj(V h ,W) = 0 for V' £ T H P. In fact, as the decomposition 
in (12.191) is orthogonal for 6 L , we have ui(V H , V') = 0 for V' £ TU\p, and thus V H £ kerw. The 
proof of our lemma is complete. □ 

By (12.1(11) and Lemmas 12.5112.61 and 12.71 we have proved Theorem 10.21 


2.2. The Kodaira Laplacian and the operator induced on B. We define the vector bundle 
£, and E p (p > 1) over M by 


(2.33) 


£ = A°'*(T*M)®E. 

E p = A°’*(T*M) ® E®L p . 


Recall that g™ is a J- and G -invariant metric on TM (we do not assume that (10.251) holds 
in this section). We endow E p ) with the L 2 scalar product associated with g™, h L and 

h E as in (USD- Then the Dolbeault-Dirac operator D p defined in (10.191) is a formally self-adjoint 
operator acting on < ^’ 00 (M,E P ). 

We now recall the Lichnerowicz formula for the Kodaira Laplacian D 2 . 

Let V™ be the Levi-Civita connection on ( M,g™). We denote by P T< ° )m the orthogonal 
projection form TM C onto T^’^M. Let v T<10,M = pT (1 ' 0) MyTMpT (1 ' 0) M ^.^g j nc Juced 

connection on T^ 1 , 0 ^M. We endow det(T 1,0 M) with the metric induced by g™ , and we denote 
by V det the Hermitian connection on det(T 1,0 A/) induced by V T M . Let i? det be the curvature 
of V det . 

Let (wi, ..., w n ) be an orthonormal frame of (T ( - 1,0 ' > M, g™), and (ei,...,e 2 n ) be the or¬ 
thonormal frame of (TM,g™) given by 


e 2j-l = ~J={Wj + Wj) 


and e2j = ~vT^ Wj ~ Wj ^ 


(2.34) 
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Let {e k } be the dual basis of {e*,}. The Clifford action of T£M on A 0, *(T*M) is defined by 
linearity from 

(2.35) c(wj) := V2vP A and c(Wj) := —y/2i^ r 

We then define a map, still denoted by c(-), on A (T£M) by setting for ji < ■ ■ ■ < jk- 

(2.36) c(e n A ■■■ A e Jk ) := c(e h )... c{e jk ). 

Let T™ and T det be the connection forms of V™ and V det associated with the frames {e^} 
and w i A • • • A w n . Define the the Clifford connection on A 0, *(T*M) (see [21 (1-3-5)]) by the 
following local formula in the frame { w 11 A ■ ■ ■ A uf lk }: 

(2.37) V C1 = d + ^ e j) c ( e i) c ( e j) + ^ rdet - 

h3 

We also denote by V C1 the connection on £ induced by V C1 and V B . 

Let Q be the real (1, l)-form defined by 

(2.38) n = g™(J-,-). 

On A 0, *(T*M), we define the Bismut connection V Bl by 

(2.39) V Bi = Vy 1 + ^^c(i v (d - d)Si). 

This connection, along with V E and V L , induces connections V £ and V Ep on £ and E p . More¬ 
over, we know that (see e.g. ]T5] Thm. 1.4.5]) 

2 n 

(2.40) A> = E c ( ei ) V £- 

2=1 

Let A Ep is the Bochner Laplacian on E p induced by V Ep . It is given by the following formula: 
if ( g l i) is the inverse of the matrix ( gij) = (g™{ei, e^)), then 

(2.41) A Ep = -g ij (v Ep V Ep - . 

Let r M be the scalar curvature of (M,g™). Let tUf be the smooth self-adjoint section of 
End(£) given by 

r M i /ITT - 1 „ 

(2.42) y £ = — + c (R e + -R det ) + l—c(ddSl) - -|(<9- o>)0| . 

4 2 2 8 

cJd = - E R L (. w i^j)w j A iwi, 

i ,0 

T = E R L (Wi,Wi). 

i 

The Lichnerowicz formula (see for instance Rj Thm. 1.4.7 and (1.5.17)]) reads 

(2.44) D 2 p = A Ep -p(2 Wd + r) + T £ , 

Let g E , g Bl and /r Ep be the moment maps induced by V E , V Bl and V Ep as in m- Recall 
that /i is defined in (ED - Then we have 

g L = 2i7r/i, 

g Ep = 2 inpg + g E + gP 1 . 


Set also 

(2.43) 


(2.45) 
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Assume now that G acts freely on P, and recall that we then choose the G-invariant neigh¬ 
borhood U of P so that G acts freely on its closure U. Using the procedure of Section [j] for 
U — > U/G = B and g™\u, we can define the operator induced by D 2 on B. Thanks 

to Theorem D and (12.441) . we find that in the case of a free G-action on P, 

( 2 . 46 ) = a e p , b _ p ( 2 Wd + r) + - {j?>, jl Ep ) g TY - h^Ash. 

Here, we have kept the same notation for an element in < ^ 700 (f7, End(E p )) G and the induced 
element in < ^’°°(B, End(E Pj s)), and we will always do this in the sequel. 

3. Localization near P 

The goal of this section is to prove the localization of P^e * p Pc near P, i.e., we prove 
Theorem 10.81 

Let inj M be the injectivity radius of (. M,g ™), and e e]0,inj M [. 

For Xq £ M, we denote by B M (xo,e) and B Tx o M (0,e) the open balls in M and T Xo M with 
center Xo and 0 and radius e respectively. If exp^ is the exponential map of M, then Z £ 
B Tx o m (0,e) i-a exp ^(Z) £ B m (xq,s) is a diffeomorphism, which gives local coordinates by 
identifying T Xo M with R 2 ” via an orthonormal basis {e*} of T Xo M: 


(3.1) (z 1} z 2n ) e T X M. 

i 

From now on, we will always identify B Tx o M (0,e) and B M (xo,e). 

Let Xi,.. .Xn be points of M such that {C4 = {xk,s)}^ =1 is an open covering of M. On 

each Uk we identify Ez, Bz and A 0, *(T|M) to E Xk , L Xk and A°’*(T* fc M) by parallel transport 
with respect to V s , V L and V Bl along the geodesic ray t £ [0,1] i-A tZ. We fixe for each 
k = 1,..., N an orthonormal basis of T Xk M (without mentioning the dependence on k). 
We denote by Vy the ordinary differentiation operator in the direction V on T Xk M. 

Let {ifik}k be a partition of unity subordinate to { Uk}k■ For i £ N, we define a Sobolev norm 
II ' \\h 1 (p) on the l -th Sobolev space H e (M, E p ) by 

(3.2) H s II«T P ) = EE E l|V eil ...V e ^(^ S )||| 2 . 

k j=0 


Lemma 3.1. For any m £ N, there exists C m > 0 such that for any p £ N* and any s £ 
H 2m+2 (M,E P ), 

m+1 

(3.3) IMlWifr) < C m p 4m+4 Y; P~* j \\ D l j s\\L*- 

3=0 

Proof. This is proved in [15] Lem. 1.6.2]. □ 

Let /: M —> [0,1] be a smooth even function such that 

1 for |t| < e/2, 

0 for |t| > e. 


(3.4) m = 

For u > 0, <; > 1 and a £ C, set 


(3.5) 


F„(a) = [ e lv ' /2a exp(-v 2 /2)f(v^u) 

J R 

G u (a) = [ e wv/2a exp(-i; 2 /2)(l - f{vy/u)) 

J R 


dv 

7^’ 


dv 

7 ^’ 
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These functions are even holomorphic functions. Moreover, the restrictions of F u and G„ to 
M lie in the Schwartz space <S(R), and 

(3.6) F u (vD p ) + G u (vD p ) = exp (-v 2 Dp) for v > 0. 

Let G u (vL p )(x,x') be the smooth kernel of G u (vL p ) with respect to dvM(x'). 


Proposition 3.2. For any m £ N, uq > 0, e > 0, there exist C > 0 and N £ N such that for 
any u > uq and any p £ N*, 


(3.7) 



?”{MxM) 


< Cp N exp 



Here, the < € m -norm is induced by V L , V s , V Bl , h L , h E and g™■ 


Proof. This is proved in [T51 Prop. 1.6.4], □ 

Proof of Theorem \0.8\ As 0 is a regular value of p, there is eo such that 

(3.8) /r: M 2eo := (0, 2e 0 )) —»• B B * (0, 2e 0 ) 

is a submersion. Note that M 2eo is an open G-invariant subset of M. 

Fix e, cq small enough so that M 2eo C U and d M (x, y) > 4e if x £ M eo and y £ M\XJ. We 
set V eo =M\ M eo , which is a smooth G- manifold with boundary dV eo . Then M\U C V f0 . 

We denote by D p jj the operator D p acting on V €o with the Dirichlet boundary condition. 
Then D p jj is self-adjoint. 

By (22 Sects. 2.6, 2.8] and [T5] Append. D.2], we know that the wave operator cos (uD p ^) is 
well defined and its Schwartz kernel cos(uD Pi d){x,x') only depends on the restriction of D p to 
G ■ B m (x, u) D V eo and vanish if d M (x, x') > u. Thus, by (13.511 . 

(3.9) Fi /u/pD p ^j (x,x r ) =Fh (^/u/pDp'io'j (x,x r ) if x, x' £ M \ U. 

O 

Let s £ < if 00 (M,Ep) G with supp(s) C V Co . Since D p commutes with the G-action, we know 
that D p s £ L p ® E) G . Moreover, from the Lichnerowicz formula (12.441) . we get 

(3.10) (-DpS, s) = || V Ep s||| 2 - p{{u d + t)s, s) + ('Fes, s). 

Observer that, as s £ L p ® E) G , (11.31) gives 

(3.11) = (C k +p^(K))s = p^(K)s , 

^ ° 

and thus by (12.451) and the fact that supp(s) C V eo , 

||V E ^||| 2 >g^||v^ s ||| 2 = G^ W^msWl, 

i i 

(3 - 12) >Cp 2 \\\p\s\\l>-C'\\s\\l. 

>Cey\\s\\l 2 -C'\\s\\l 2 . 

Thanks to (13.101) and (13.121) . we have 

(3.13) (D p s, s) > Gp 2 ||s||| 2 . 

In particular, as Pq preserve the Dirichlet boundary condition, there are G, C' > 0 such that for 
P > 1 , 

(3.14) Sp (P G D 2 p D P G ) c [Cp 2 , +oo[. 

By the elliptic estimate for the Laplacian with Dirichlet boundary condition ]22 Thin. 5.1.3], 
we can see that the proof of Lemma [3.11 (see [151 Lem. 1.6.2]) still works if we replace therein 
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D p by D p j) and take s £ H 2m+2 {M, E p ) D H\(M, E p ). Using this modification of Lemma T3. II 
(13.14[) and 

(3.15) sup \a m F,(aV^)\<C m , k , uP - k , 

a>Cp p 


we find that for any Q , Q differential operators of order 2 to, 2m' with scalar principal symbol 
and with support in Ui , Uj and for any k £ N 


(3.16) 


QF a ( 'y/u/pDp tD J Q's 


L 2 


< c„ 


u P - k \\s\\L 2 - 


Thus, using Sobolev inequalities with (13.161) . and (13.61) . (13.71) and (13.91) . we get Theorem 10. 81 


□ 


4. Asymptotic of the heat kernel near P for a free action 
We assume in this Section that G acts freely on P and U. 

In this section, we prove Theorem 10.91 In Section 14.11 we work near P and replace our 
geometric setting by a model setting, in which M is replaced by G x R 2n_d , P by G x R 2ra_2d x {0} 
and the different bundles are trivial. We can then define a rescaled version of 1.D 2 , and in 
Section POl we prove the convergence of the heat kernel of the rescaled operator. In Section [TT7TI 
we compute the limiting heat kernel to finish the proof of Theorem 10.91 


4.1. Rescaling the operator $Z? 2 <I> _1 . This section is analogous to [T6J Sect. 2.6], with the 
necessary changes made. 

We fix xq £ Mq and e s]0,inj M /4[. 

Recall that we have the following diagram: 


G 

M g C- 


u 


B 


Recall also that g T p is a G-invariant and J-invariant metric on T H P, g T y is a G-invariant 
metric on TY and g JT5 is the G-invariant metric on JTY induced by J and g T ^ . Then by 
(12.191) . we can chose be a G-invariant metric g™ on M such that on P : 


(4.1) 


n TM | _ TY\ a,n JTY \ , 

9 I P — 9 I P® 9 Ip 1 


T P 


Let g THu be the restriction of g™ on T H U. Let g TB (resp. g™ G ) be the metric on TB 
(resp. TMq) induced by g T u (resp. g T p ). 

By (10.241) and Lemma l2~Tl we know that 


(4.2) 


T h U\ p = JTY\ P © JT h P = JTY\ P © T H P. 


As a consequence, if Nq denotes the normal bundle of Mq in B, then Nq can be identified as 

(4.3) N g ^ (TM G ) ±gTB = (JTY) b \ Mg , 

where {JTY)b denotes the bundle over B induced by JTY. 

Let V TB be the Levi-Civita connection on {TB : g PB ). Let P Na and P™g be the orthogonal 
projections from TB\m g to Nq and TMq respectively. Set 

\7 Ng = P Ng {S7 tb \ Mg )P Ng , V™ G = P™ g {\7 tb \ Mg )P™ g , 

°V TB = V Ng © V™ G , A = V TB | Mg - °V TS . 


(4.4) 
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For W G T Xo Mg, let u G R i-A x u = exp ^°(uW) G Mg be the geodesic in Mg starting at xq 
with speed W. If \ W\ < 4e and V G Ng, X o , let twV be the parallel transport of V with respect 
to V Wg along to curve u G [0, 1] i-A x u = exp^ G (uVF). 

If Z G T Xo B, we decompose Z as Z = Z° + if- 1 with Z° G T Xo Mq and if- 1 G Ng, X q , and if 
\Z°\, \ Z ± \ < e we identify Z with exp 5 Mq o (jzoZ^). This gives a diffeomorphism 

expxo ) 

(4.5) F: B Tx o Mg (0,4e) x (o, 4e) —A &(x 0 ) C B, 


where (xo) is an open neighborhood of xq in B. Note that under this diffeomorphism, % (xo) D 
Mg is identified with (B Tx o Mg (0, 4e) x {0}). 

In the sequel, we will indifferently write B Tx o Mc (0,4e) x B Ng ’ x o(0,4e) or ^(xo), Xo or 0, 

etc... 

We identify ( L B )z , (E B )z and (E p )b,z with ( L B ) Xo , (E B ) X0 and (E p ) Bia;o by using parallel 
transport with respect to V 5s , V 5s and V (Ep -* B along the curve u G [0,1] H > = uZ. 

Fix y 0 G 7r _1 (xo). We define 7: [0, 1 ] —> M to be the curve lifting 7 such that G T 5 Lb As 
above, on 7r _1 (I? T:r o 5 (0,4e)), we can trivialize L, E and E p using the parallel transport along 7 
with respect to the corresponding connections. By m, the previous trivialization are naturally 
induced by this one. 

This also gives a diffeomorphism 

(4.6) 7 r- 1 (B r -o B (0,4e)) ~ G x B T ^ 5 (0,4e), 

and the induced G-action on G x B Tx o 5 (0,e) is then 


(4.7) 


g-(g',Z) = (gg',Z). 


Let {e°} and {e^} be orthonormal basis of T Xo Mq and Ng, Xo respectively. Then {d} = 
{e°, ef} is an orthonormal basis of T Xo B. Let {e*} be its dual basis. We will also denote J r *(e°), 
F*(ej-) by {e°}, {e^}, so that in our coordinates, 


(4.8) 


dZ? 


= e,- 


dZj- 


= 


In what follows, we will extend the geometric object from B Tx ° 5 (0,4e) to R 2n d ~ T Xo B (here 
the identification is similar to m) to get analogue geometric structures on G x R 2 " d as on 
M, an thus work on 


(4.9) 


M 0 := G x R 2 ”- 


instead of M. 

Let Lq be the trivial bundle L|G.y 0 lifted on M 0 . We still denote by V 5 , h L the connection and 
metric on Lq over n~ 1 (B Tx o B (0 : 4e)) induced by the above identification. Then h L is identified 
with the constant metric h L ° = h Ly o . We use similar notations for the bundle E. 

Let <p: R —> [0,1] be a smooth even function such that 


(4.10) 


1 for |u| < 2, 
0 for |i>| > 4. 


Let ip s : Mq —> M 0 defined by 


(4-11) <p E (g, Z ) = ( g, <p(\Z\/e)Z). 

Let V 5 ° = <^*V 5 . Then V 5 ° is an extension of V 5 outside tt~ 1 (B Tx o b 
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Let be the orthogonal projection from TM onto TY. For W £ TB, let W H £ T H U be the 
horizontal lift of W. Then we can define the Hermitian connection V L ° on (Lq, h L °) aGx 

by 

(4.12) V L ° = ^V L + (1 - v{\Z\/e))R L yo (Z H 

We can compute directly the curvature R L ° of V L °: if we denote (1, Z) just by Z, then 


R L Z ° =B, r : r^(Pl Y -,P‘. 


^Ve( z )\ r y 0 


•j + R l (P 1 

> ~ o \ mi 


(4.13) 


+ V 2 (\Z\/e)R^ z) (P* 0 U -,P , 

+ <pM M[R L M Z) -Ry 0 }(Pr u ;PZ Y -) 


T U' 
yo 

t h u 


P TY .) 

yo ) 

) 

->ty 


y o 
H 


+ ^(\ z \/e)— ] A[R L Vs{z) ~ R ^](Z H , p ^-) 


+ ( W ')(l Z\!e)P- A R^ z) (Z h ,PI H u -) 


£ \z\ 


where Z* £ T* Q B is the dual of Z £ T Xo B with respect to the metric g x B . 

The group G acts naturally on M 0 by (1X71) and under our identifications, the action of G on 
L, E on G x Tx o B (0, e) is exactly the G-action on L\a. yo , E\g. V o - 

We define a G-action on Lq, Eq by the action of G on G.yo- Then it extends the G-action on 
L , E on G x Tx o B (0, e) to M 0 . 

By Lemma 1XX we know that 


(4.14) 


R^ z0) (Z h ,K m ) = R^ z0) ((Z x ) H ,K M ). 


For (1 ,Z) £ G x R 2n d , (14.71) gives tp et ,K^° z ^ = K™ for K £ g. Thus, by (10.71) . (14.121) and 
(14.141) . the moment map go : M 0 — » g* of the G-ac( (M 0 , L 0 ) is given by 

(4.15) =M^Wi,z) + ^(l-^(I^IA))i^((^ ± ) H ,0 

Now, from the construction of our coordinate, we have /Jo = 0 on G x ]g> 2 ra- 2 d x |q| Moreover, 

(4.16) |i(% ( i,z) = ^R^ z M\Z\/e){Z^) H ,K M ) +0(^\Z\/e)\Z\\Z ± \). 

Thus, from our construction, Lemma 1X51 and (14.31) . (14.151) and (14.161) . we know that 


(4.17) 


/i„ 1 (0) = Gxl 2 "- M x {0}. 


Let 


(4.18) g™°(g,Z)=g™(<p e (g,Z)) and J 0 (g, Z) = J(<p e (g, Z)) 

be the metric and almost-complex structure on Mq. Let T*( 0,1 )Mo be the anti-holomorphic 
cotangent bundle of ( M 0 ,J 0 ). Since Jo(g,Z) = J(ip e (g,Z)), T*^° z ^ Jq Mq is naturally identified 

with t;^ z) j m 0 . 

We can now construct all the objects corresponding to those of Section 1X21 in this new setting 
and denotes them by adding subscripts 0, e.g. E 0 , p , V det °, V cl °, V Bl °, V E °’ P , ... Then, we can 
define the Dirac operator D^ 0 on Mo, which satisfies 

(4.19) = A Eo '*> - p(2 Wd ,o + t 0 ) + V £o . 

By (12.441) and the above constructions, we know that D 2 and Dp 10 ’ 2 coincide on tt~ 1 (B Tx o b (0, 2e)). 
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We can identify A°’ a (T* gZ) M 0 ) with A °’*(T* yo M) by identifying first A°’ a (T* gZ) M 0 ) with 
A 0, *(T* e ( ffZ ) jM) and then identifying A°'*(T*^^ g Z ) jM) with A °’ m (T* yo M) by parallel trans¬ 
port with respect to V Bl ° (see (12.391) 1 along u £ [0,1] i-A (g,mp(\Z\/e)Z). We also trivialize 
det(T( 1 ’°)M 0 ) in this way using V det °. 

Let g TB ° be the metric on Bq := R 2n_d induced by g ™°, and let dvs 0 by the corresponding 
Riemannian volume. We denote by TYq the relative tangent bundle of the fibration Mq Bq, 
and by g T ^ 0 the metric on TYq induced by g ™°. 

The operator <bPP f °’ 2 <l> _1 is also well-defined on T Xo B ~ R 2n_d . More precisely, it is an 
operator on the bundle (Eo. p )b 0 over Bq induced by Eo. p , and by (12.461) . it is given by 

(4.20) SD™ 0 ’ 2 ®- 1 = -p(2u 0 ,d + V }) + ^£o - (£ E °' P g ^o - j-A Bo ho- 

no 

Let exp(— uD^°’ 2 )(Z, Z 1 ) be the smooth heat kernel of D^ 0 ’ 2 with respect to dvM 0 { z ')- 


Lemma 4.1. Under notation of Proposition 13.2\ and the above trivializations, the following 
estimate holds uniformly on v = (g,Z),v' = ( g', Z ') £ G x B Tx o B (0,e): 


(4.21) 


-±D. 


( f\ 

p (v, v ) — e 


_u jjM 0 ,2 


((g, z ),(g', z ')) < Cp N exp (— 


16m 


Proof. By (14.191) . D^°’ 2 has the same structure as D 2 . Thus Lemma l3Jl and Proposition [32] are 
still true if we replace D 2 therein by D g l0 ’ 2 . Moreover, as -D p /o ’ 2 and D 2 coincide for |Z| small, 
by the finite propagation speed of the wave equation (see e.g. [T5J Thm. D.2.1]), we know that 

(4.22) F, TpD v ) (v, •) = F, ( TpD »"°) ({g, Z), •) 

if v = ( g , Z) under the above trivializations. Thus, we get our Lemma by (13.61) . □ 


We still denote P G the orthogonal projection from Q°’*{U,L P (g) E ) onto f l°'*(U,L p (g) E) G . 
Let dg be the Haar measure on G. Then we have 

(4.23) (P G e~p D rP G )(v,v') = [ (ff,ff ,_1 ) • e~p Dp (g~ 1 v,g'v')dgdg l . 

JGxG 

If we again denote by P G the orthogonal projection from fl°’*(M 0 , Lq®Eq) onto Cl 0 ’* (Mo, Pg ® 
Eq) g , then we have a similar formula as (14.231) for ( P G e~p Dp ° P G ). Thus, as G preserve every 
metrics and connections, Lemma 14.11 implies 


Corollary 4.2. Under notation of Proposition^^ the followinq estimate holds uniformly on 
v = ( g,Z),v ' = (g',Z') £Gx B t * o*(0, e ); 


(4.24) 


(P G e p D ?P G )(v,v) - (P G e 


_U jjMq,’ 


P G )((g,Z),(g',Z')) 


e 2 p , 


< Cp N exp (— 


Let Sl be a G -invariant unit section of P| Gyo . Let pr be the projection G x R 2n d —> G. 
Using Sl and the above discussion, we get two isometries 

(4.25) E 0:P = A 0, *(T*Mo) ® E 0 ® Pg ~ pr*(P| Gyo ) and (E 0iP ) Bo ~ £ B , Xo - 

Thus, ‘bD™ 0 ’ 2 ®- 1 can be seen as an operator on £b,x 0 - Note that our formulas will not depend 
on the choice of Sl as the isomorphism End((Eo lP )s 0 ) ~ End(fs >Xo ) is canonical. 

Let dvTB be the Riemannian volume of (T Xo B, g TB ). Recall that n is the smooth positive 
function defined by 


(4.26) 

with k(0 ) = 1. 


dv Bo (Z ) = K(Z)dv T B{ z ) = n(Z)dvM G (x 0 )dv Nl 
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As in (11.71) . we denote by R Lb , R Eb and R Bib the curvature on Lb, Eb and (A 0, *(T*M)) B 
induced by V L , V s and V Bl on M. 

As in (11.41) . jl £ TY , ]1 E £ TY (g End)!?) and Jl Bl £ TY g End(A 0, *(T*A/)) are the sections 
induced by g,, g E and g Bl in (11.31) and (12.451) . 

We denote by Vy the ordinary differentiation operator on T Xo B = B 0 in the direction V. 

We will now make the change of parameter t = -E £ ]0, 1], 


Definition 4.3. For s £ Y? °°(R 2 " d ,£B,x 0 ) and Z £ R 2 ” d set 
(S t s)(Z) = s(Z/t), 


V( = tSi 1 k 1 /2 V^°’P )b ° K~ 1/2 St, 


(4.27) 


V 0 = V + £R Bb (Z, ■), 


1 

2 l " Xo 

= t 2 S , - 1 K 1 / 2 $Df'» 2 $- 1 K-i/25 t , 


* - ^ —p 

2 n—d 


= (Vo.eJ 2 - 2u; d , Xo - T X0 + 4n 2 \P TY J X0 Z\ 2 . 


Proposition 4.4. When t —> 0, we have 

(4.28) V t , ej = V 0 , ei + 0{t) and = JSf 0 + 0(f)- 

Proof. Let T Lb , T Eb and T Bib be the connection form of V Lb , V Sb and V Bib with respect to 
fixed frame of Lb, Eb and (A 0, *(T*M)) fi which are parallel along the curve u £ [0,1] K► uZ 
under our trivialization on B Tx o B (f), Ae). 

By (14.271) . we have for |Z| < e/t 

(4.29) Vt.ej (Z) = k 1 ' 2 ( tZ) {v e , + (t-'rfi(et) + tTf B ( e< ) + fT^ B ( ei )) } k” 1/2 (tZ). 

It is a well known fact (see for instance [TQ Lemma 1-2.4]) that for if T = T Lb (resp. T Eb , 
E Bib ) and R = R L (resp. R Eb , R b ' b ), then 

(4.30) r z (ej) = \R X0 {Z, et) + 0(\Z\ 2 ). 

Thus, 

trf/(e i ) + tr t B i B (e i ) = o(t 2 ), 

(4.31) 1 

t- 1 T E z (e i ) = -R E 0 (Z,e i ) + O(t). 

The first asymptotic development in Proposition 14.41 follows from y>(0) = k( 0) = 1, (14.291) . 
dOIB and (ITTTTD . 

Let (gS(Z)) is the inverse of the matrix ( gij(Z )) := (g^. x ° B (ei, ej)). By (12.411) . (14.201) and 
(14.271) we have 


(4.32) 2 t (Z) = - g ij (tZ ) (v t , 6i V t , e . - - {tg^ ,tg^) gT y (tZ) 

— (2wo ,d + r 0 )(tz) + 1 2 ^ v f , £ 0 + — As 0 ho^ ( tZ ). 

With the asymptotic of V t above, (12.411) and the fact that g l i{ 0) = Sij we find 

(4.33) - g^(tZ) (v t , ei V t , e3 . - tV ty TB 0 ^ = ^ (V 0 , e J 2 + O(i). 
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Moreover, 

(4.34) — (2wo,d + To)(tZ) +1~ ^ 1 3E , £ 0 + — As 0 /io^ (tZ) = —2 uJd,x 0 — t Xo + 0(t). 

Now, by (12.111 . (10.261) and the fact that g yo = 0 for y 0 £ P, n(yo) = Xq, we get for K £ g: 

(4.35) - (3ef,K M ) V0 = Lu(K M ,e?) yo = V e? (»(K))(y 0 ) = {W T e ffi,K M ) y0 . 

Thus, 

(4.36) \g\] t Y (Z) = |Vl F /I|2 Ty + 0(|Z| 3 ) = |P Ti % 0 Z| 2 Ty + 0(|Z| 3 ). 

Note that 

(4.37) {tJl Ep 1 tjl E ’’) g TY = -An 2 ^\Jl\ 2 gTY + (4inj2 + t 2 (jl E + /x Bl ),/x B +jl Bl ) gTY . 

Thus, we get the second asymptotic development in Proposition 14.41 bv using (14.321) . (14.331) . 

• firm :, gasp and l imn . □ 


4.2. Convergence of the heat kernel. In this section, we prove the convergence of the heat 
kernel of the rescaled operator. Note that here we must have a more precise result than in na 
Sect. 1.6] because in the proof of Theorem 10.31 fsee Section l5Tl) we will have to integrate along 
the normal directions, and thus we need a result of decay in these directions. To obtain it, we 
draw our inspiration form [Ill- 

Recall that £o = A 0 ’* (T*Mo)<8>i?o and that we have trivialized the Hermitian bundle (£o,b 0 , h £ °’ B o) 
on B 0 = T Xo B by identifying it to (£B,x 0 ,h £B ' x o). Recall also that go : Mo -» g* is the moment 
map of the G-action on Mo- 

Let || • \\ L 2 be the L 2 -norm on ^’ oo (P 0l £b,x 0 ) induced by g Tx o B and H £b - x o as in (11.81) . 

Let {/;} be a G-invariant orthonormal frame of TY on 7r _1 (B b (xq, 4e)), then {foj(Z) = 
fi(<p E (g, Z))j is a G-invariant orthonormal frame of TYq on Mq. 

Definition 4.5. Set 

(4.38) T> t = |Vt, ei , 1 < i < 2n - d ; -(j2 0 , f 0 ,i)(tZ ), 1 < l < d|, 

and for k £ N*, let be the family of operators Q acting on ^°°{T Xo B 1 £B t x 0 ) which can be 
written in the form Q = Q\ ... Q m with Qi £ D t . 


For s £ ^°°{Bo,£b,x 0 ) and k £ N*, set 

IMI?,o = IMI 


2 

L 2 ; 


(4.39) 


all 


2 

t,m 


lb 


£ £ iio*i 

^=i QeT>‘ 


2 

t, o- 


We denote by H™ the Sobolov space H m (B 0 l £B,x o ) endowed with the norm || • ||t, m , 
if jT 1 the Sobolev space of order —1 endowed with the norm 


(4.40) 


IM|t,-i = sup 

s 'eiTj\{0} 


(s,s') t ,o 

ll s 'lko 


and by 


Finally, if A £ ^(H k t , if™ ), we denote by ||A||j’ m the operator norm of A associated with 
II * ||t,fc and || • ||t,rrt- 

Then is a formally self-adjoint elliptic operator with respect to || • |ko and is a smooth 
family of operators with respect to the parameter Xq £ Mq. 

We denote by ^’^°(Bo, £b,x 0 ) the set of smooth section of £b,x 0 over B 0 with compact support. 
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Proposition 4.6. There exist constants C\, C %, C 3 > 0 such that for any t €]0,1] and any 
s, s' £ ^?° (Bo, £b,x 0 ), 

(^ts, s)t,o > C'lIl s ll?,i - C- 2 || S ||?, 0 , 

|(2z? t s,s')t,o| < C' 3 ||s||t j i||s , || t ,i. 

Proof. From (14.321) and (14.391) . we have 

(4.42) {J? t s,s) tl 0 = ||V tS ||2 0 -t 2 ((/I Eo -,/I Eo -) g Tv(<Z) S , S ) t!0 

+ (\S t 1 ^ — (2 uo,d + t~o) + t 2 + — As 0 /ioj ) s j 

By (14.151) and our constructions, we know that for Z £ T^ Xo B with \Z\ > 4e, 

(4-43) ^(K) ihZ) = 2inp^(K) {ltZ) =pR^((Z ± ) H ,K^ o ). 

Thus, from (11.121) . (14.151) . (14.37j) and (14.431) . we get 


(4.44) — t 2 g TY (tZ)s, s) t Q > 27t 2 ^2 || t(MO) fo,i)(tZ)s 

1=1 

Now, (14.411) follows from (14.421) and (14.441) . 

Let T be the contour in C defined in Figure Q] 


Ct\\s\\l 0 . 


□ 



Proposition 4.7. There exist to > 0 and C > 0, a, b £ N such that for any t e]0, £ 0 ] an d an U 
A £ r, the resolvant (A — J Z’t) exists and 


(4.45) 


(A -Aft)" 1 
(A — 2z? f ) -1 


0,0 

t 


<c, 


- 1,1 

t 


<C(1 + |A| 2 ). 


Proof. Note that is self-adjoint operator, thus (|4.41[) implies that (A — JZt) 1 exists for AeT 
and there is a constant C > 0 (independent of A) such that 

(A — 


(4.46) 


t 


< C. 
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On the other hand, if Aq £] — oo, — 2 C 2 ], then (14.411) also implies that 


(A 0 — Jz? t ) 


1 > 1 1 

< —. 
t ~ Ci 


(4.47) 

Then, using the fact that 

(4.48) (A - = (A 0 — ^t)~ l — (A — Ao)(A — Jz? t ) -1 (Ao — TZf) 

we find that 

(4.49) 


(a -j? t y 


< — (1 + C|A — Ao|). 

t Oi 


Finally, exchanging the last two factors in (14.481) and applying (14.491) . we get 


(4.50) 


(A - JS? t ) 


-1 


< — 

“ Ci 


1 . |A — Aq 


c? 


(1 + C|A — A 0 1) 


<C(1 + |A| 2 ). 


The proof of our Proposition is complete. 


□ 


Proposition 4.8. Take m £ N*. Then there exists a contant G m > 0 such that for any t £ ]0,1], 
Qu ■ • ■, Qrn £ Vt U {Z t j 2 Tf d and s, s' £ V^{B 0 ,£ b ,x 0 ), 


(4.51) 


[Ql, IQ2, ■ ■ ■ [Qmi-^t] ■ ■ ■ ]]s, s' 


t, 0 


< C m ||s||t j i||s , ||t j i. 


Proof. First, note that [V tie( , Zj\ = Sij. Thus by (14.321) . we know that [Zj,^C t ] satisfies (14.511) . 

Using (14.151) and (14.431) . we see that (V ei {no, fo,i)) (tZ) is uniformly bounded with its deriva¬ 
tives for t £ [0,1], and for \Z\ > 4e, 

(4-52) (V ei (Jlq, fo,i)){Z) = (ej(/z 0 , fo,i)) XQ = Ux 0 {fo,i,ei). 

Thus, fo,i){tZ),^ t ] also satisfies (14.511) . 

Let Rf L °) B o and R ( - £ °'> B 0 be the curvatures of the connections on ( L 0 )b 0 and (£q)b 0 induced 
by V L °, V B ° and V Bi °. Then by (TQ71) . we have 

(4-53) [V t , ei ,V t , ej ] = ( R l °’ b ° +t 2 R £ °’ B °) tz ( ei , ej ). 

By (14.321) . (14.521) and (14.531) . we find that JS?t] has the same structure as T£ t for t £ ]0,1], 

by which we mean that it is of the form 


(4.54) 5>;(M^)V t , ei V t , ei +^& i (f,fZ)V i ,e i + c(t,tZ) 


h3 


+E 


di(t, tZ)-{no, f 0 , 1 ) (' tZ ) + d! 


1_ 

2 

-MO 

9 ty _ 


where d! £ C, and a^-, bi , c and di are polynomials in the first variable, and have all their 
derivatives in the second variable uniformly bounded for Z £ R 2n_d and t £ [0,1]. Note that in 
fact, for [V t)ei , Jf t ] , d’ = 0 in (14.541) . 

The adjoint connection (Vt)* of V t with respect to (•, -) ti o is given by 

(4.55) (V f )* = -Vf - t ^ 1 Vk) {tZ). 

Note that the last term of (14.551) and all its derivative in Z are uniformly bounded for Z £ R 2n_d 
and t £ [0,1]. Thus, by (14.541) and (14.55[) . we find that (14.511) holds when m = 1. 

Finally, we can prove by induction that [Q 1 , [Q 2 ,... [Q m , dZt] ■ ■ ■ ]] has also the same structure 
as in (14.541) . and thus satisfies (14.511) thanks to (14.5511 . □ 
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Proposition 4.9. For any t G]0,io]> A £ T and m £ N, 

(4.56) (A - Jzfi) _1 (#r) C H™ +1 . 

Moreover, for any a £ N 2n_d , there exist K £ N and C a ^ m > 0 such that for any t G]0,1], 
A G T and s £ ^^(Bq^b^o), 

(4.57) \\Z a (X - JZt )- 1 *|| tjm+1 < C a , m ( 1 + |A| 2 )* Y, \\ za ' s W,m. 

Proof. Let Q i,..., Q m £ Pt and Q m + i, • ■ ■, Q m +\a\ G Then we can express the operator 

Q i... Q m +\a\{X — A^t)” 1 as a linear combination of operators of the type 

(4.58) [<2i,[Q 2 ,---[Qt,(A-Jz? t ) -1 ] ...]]Qe+i...Q m +\ a \ with £<m+\a\. 

We denote by the family of operator = {[Qj ± , [Qj 2 , ■ ■ ■ [Qj k ,-&t] ■ - •]]}• Then any 
commutator [Q i, [Q 2 ,... [Qi, (A — 2z?t) _1 ] ■ • • ]] can be expressed as a linear combination operators 
of the form 

(4.59) (A-J? t )- 1 F 1 (A-J%)- 1 F 2 ...Ft(A-JZ’ t )- 1 with F, £ & t . 

Moreover, by Proposition 14.81 the norm || • ||^’ — 1 of any element of is uniformly bounded by 
C. As a consequence, using Proposition 14. 71 we see that there is C > 0 and N £ N such that the 
|| • Hjd-norm of operators in (14.591) is bounded by C{ 1 + |A| 2 )^. Thus, Proposition 14.91 holds. □ 

Let er <£t [Z, Z') be the smooth kernel of the operator e”- 2 * with respect to dvTB(Z'). Let 
ijk c : TB Xm g TB -a Mg be the projection from the fiberwise product TB Xm g TB onto Mq 
(here we should rather write TB\m g but we drop the subscript to simplify the notations). As F£t 
depends on the parameter Xq £ Mg, then •) can be viewed as a section of tt* Mg (End(£s)) 

over TB Xm g TB. 

Let v 7rM G End( T £ d kg ^e connection on 7rM G End(£s) induced by V £s . Then v 7rM c End ^ B \ h E 
and g™ induce naturally a < ^ m -norrn for the parameter xq £ Mg on sections of n* Ma (End(£s)). 
As above, we will decompose any Z £ T Xo B as Z = Z° + Z E , with Zq £ T Xo Mq and 
G N g , X0 . 

Theorem 4.10. There exists C' > 0 such that for any m,m!,m",r £ N and uq > 0, there is 
C > 0 such that for any t £ ]0, fo]> u > uq and Z , Z' £ T Xo B = Bq 


(4.60) sup (l + |Z- L | + |Z'- L |) m 

|o:|,|Q' / |<m 


Q\ a \+\ a '\ Q r 




(Z,Z') 




- \z-z' 

u 


dZ a dZ ,a ' dt r 

< C( 1 + \Z°\ + \ Z '*\f (n+r+m ' +1)+rn exp (4 C 2 u - ^ 
where \ ■ \<g m > ^m) denotes the c £ m -norm for the parameter Xo £ Mg- 
Proof. By (14.4511 . we know that for k £ N*, 

(4.61) = (-1 ^r 1>! 

Then for m G N, we know from Proposition 14.91 that for Q £ there are C m > 0 and 

Mg N such that for A G T, 


(4.62) ||Q(A - < C m ( 1 + |A| 2 ) M . 

Moreover, taking the adjoint of (14.621) . we deduce 

(4.63) ||(A - JZ’t)- rn Q\\° t ’° < C m ( 1 + |A| 2 ) m . 
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From (14.611) . (14.621) and (14.63j) . we have for Q, Q' £ U gL 1 T>j: 

(4.64) WQe-^Q'W*’ 0 < C m e 2C * u . 

Let || • || m be the usual Sobolev norm on c ^’°°(T Xo B 1 8 Xo ) induced by h £x ° and the volume form 
dvTx(Z): 

(4.65) M 2 m=Yl E IIV^ Ve^sllg. 

i<zm i\ 

Then by (14.291) and (14.391) . for any m £ N there exists C' m > 0 such that for s £ ‘jf o<:) (T X0 B, £ Xo ) 
with support in B Tx o b {Q i q) and t £ [0,1], 

(4-66) (?/ ( 1 1 +g )m ll 5 llt,m < Nlm < C' m ( 1 + g) m |Nkm- 

From (14.6411 . (14.661) and Sobolev inequalities (for || • || m ) we hnd that if Q,Q' £ then 

(4.67) sup \QzQ , z'e- u - set {Z,Z , )\<C(l + q) 2n+2 e 2C2U . 

\Z\,\Z'\<q 

Moreover, by Lemma 12.31 and (14.151) . (14.161) and (14.431) . we have 


(4.68) 




1 = 1 


2 

i„ 

= 

-MO 


( tz) > C\Z ± \ 2 . 


Thus, (14.291) . (14.671) and (14.681) imply (14.601) with the exponential e 2C2U for the case where r = 
m! = 0 and C" = 0, i.e., for any m,m" £ N, there is C > 0 such that for any t e]0,io]> 
Z 1 Z' £ T X0 B = Bq 


(4.69) 


sup (1 + |Z- L | + \Z ,± \) m 

M,|a'|<ra 


q\<*\+W\ 

dZ a dZ ,a ' 


e~ uS£t 


(Z,Z') 


< <7(1 + \Z°\ + \z'*\) 2n+2+m exp(2C' 2 tt). 


To obtain the right exponential factor in the right hand side of (14.601) . we proceed as in the 
proof of [3] Thm. 11.14] (see also [151 Thm. 4.2.5]). 

Recall that the function / is defined in dot . For c > 1 and a £ C, set 

(4.70) K u ^a) = [ e ivV ^ a exp(-v 2 /2) (l - /(v^v/?)) - J=. 

Jr v ' V27T 

Then there are C", C\ > 0 such that for any c > 0 and m, m! £ N, there is C > 0 such that for 
u > uq, ? > 1 and a £ C with |Im(a)| < c, we have 

(4.71) \a\ m \K^\a)\ < Cexp (c"c 2 u - . 

For c > 0, let V c be the image of {a £ C : |Im(a)| < c} by the map a i-A a 2 , that is 

(4.72) V c = {A e C : Re(A) > ^lm(A) - c 2 }. 

Then the contour T of Figure |T] satisfies F C V c for c large enough. 

As K u)S is even, there exist a unique holomorphic function K u ^ such that K us [ar) = K u ^{a). 
By (14.711) . we have for \£V C 

|AHir<&'>(A)| < C exp (c"c 2 u- ^V). 


(4.73) 
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Using the finite propagation speed of the wave equation and (14.701) . we know that there exists 
d > 0 such that for any <; > 1 

(4.74) K Ut ,(J? t )(Z,Z') = e- u * t (Z,Z') if \Z-Z'\>d<;. 

From (14.731) . we see that for k G N, there is a unique holomorphic function K u ,^,k defined on 
a neighborhood of V c which satisfies the same estimates as K us in (14.731) and 


(4.75) 

In particular, as in (14.611) . we have 


(4.76) 


(*-!)! 


1 


= K us { A). 


Ku ^ t) = 2m / 


Using (14.641) and proceeding as in Ij4.66ll - lj4.69ll . we find 

^|a| + |a'| 


(4.77) sup (1 + |Z- L | + |Z ,J -|) 

\ot\,\a*\<m 


dZ a dZ' a 


-K US (Z,Z') 


<C{\ + \Z°\ + \Z'°\) 


yq .\ 2n+2+m 


exp (c"c 2 u — —. 


For Z ^ Z', we set > 1 such that k — h\Z — Z'\ I < 1 in the previous estimate and get 


(4.78) sup {l + \Z^\ + \Z'^\) m 


Q\u\ + \u'\ 


8Z a dZ' a 


-K Ufi (Z, Z') 


< C{ 1 + \Z°\ + \Z'°\) 2n+2+m exp (C"c 2 u - 


C\ 


Z-Z' 


Now, take <5i = g»k+ 4 C 2 ’ t ^ ien ^ rom H4.69I) * 51 x (I4.78I) 1 Sl and (14.741) (and from (14.691) if Z = Z'), 
we get (14.601) for r = m! = 0, i.e., for all Z , Z' G T Xo B 


(4.79) sup (1 + \Z ± \ + \Z ,± \) 

\a\,\a'\<m 


Q\a\ + \a’\ 




(z,z f ) 


dZ a 8Z ,a ' 

<c(i + \z°\ + \z' 0 \) 2n+2+m 


exp ( 


We now turn to the case r > 1. By (14.611) . we have 

\k-l(i, _ 1 m r Qr 


^L e ~uS£ t = (-if-kfc-D! 

dt r 2inu k ~ 1 


dt r 


(aC 2 u - 

V u 

(A-J^) _1 rfA. 


-U, z _ z . 

u 


(4.80) 

For k, q G N*, set 

j j 

(4.81) 4,r = {(k, r) = (k t , n) G ( N*y +1 x (N*) J : £ h = k + j , J) n = r}. 

2—0 2—1 

For (k, r) G A G T, t > 0 set 

(4.82) ^(A, t) = (A - ^ t )- fc0 ^(A - A - JSf t )" fcj ■ 

Then there exist aif G K such that 

(4.83) 


Q r 

diF 


(A -J?t)~ k = ^ «Mr(Ak)- 

(k,r )G/ fc|9 
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We claim that for any to G N, k > 2(m + r + 1) and Q, Q' G there exist C > 0, N G N 

such that for A G F 

(4.84) ||Q^(A,t)Q' S || 0 <C(l + |A|) JV £ ||Z^|| 0 . 

l/3|<2r 

Indeed, we know by (14.321) that Jpr2z? t is a combination of 

/ FT 1 \ / f ) r2 \ f) ri f) ri 

< 4 - 85 > (jf* 4 aFi" <iZ) ’ JF*^** 2 * 

where 6* runs over the functions r x , etc., appearing in (14.321) . 

Now, if / = gV or f = 9 in » (resp. / = V t , ei or / = , f 0 ^{tZ))), then for n > 1, 

-^Rf{tZ) is a function of the type g(tZ)Z& where |/?| < ry (resp. ri + 1) and g(Z) and its 
derivatives in Z are uniformly bounded for Z G M 2rl . 

Let be the family of operators of the form 

(4-86) = { [f n Q n , \f j2 Q n ,... \f jm Q jm , JSf t ] ...]]} , 

where /' 7i is smooth and bounded (with its derivatives) and Q Jt GV t U {Zi}f2i d - 

We will now deal with the operator A^(\,t)Q'. First, we move all the terms Z& in the terms 
g(tZ)Z 13 (defined above) to the right-hand side of this operator. To do so, we use the same 
commutator trick as in the proof of Theorem 14.91 that is we perform the commutations once 
at a time with each Z r (and not directly with Z&, |/3| > 1). Then we obtain that y4jf(A ,t)Q' 
is of the form X^|/ 3 |< 2 r Rt,pQ'pZP where Q'p is obtained from Q' and its commutation with . 
Next, we move all the terms Vt, ei and (jjl Eo - p , fo,i(tZ)) in to the right-hand side of the 

operators L t> p. Then as in the proof of Theorem 14.91 we finally get that QA^(X,t)Q' is of the 
form where JZt,p is a linear combination of operators of the type 

(4.87) Q(A - ^ t )~ k '°Ri (A - ^ t )~ K R 2 ■ • • Rv (A - Q”’Q”, 

where kj = k +1', Rj G Q'" G and Q" G is obtained from Q' and its 

commutation with Z@. Since k > 2(to + r + 1), we can use Proposition 14.91 and the arguments 
leading to (14.621) and (14.631) in order to split the operator in (14.871) into two parts: 


(4.88) Q(A - J? t )- fc oi?i(A - JZ t )- k[ R 2 ■ ■ ■ Ri{ A - &’ t )~ k " x 

(A - ^ t )-^- k '^R i+1 • • • R,,(X - J?t)- k '''Q'"Q", 

such that the || • ||°’°-norm each part is bounded by (7(1 + |Al 2 )^. This conclude the proof of 

gm 

By (14. SOI) , (14.831) and (14.841) , we get (14.601) for m! = 0 using a similar reasoning that for (14.791) . 
For m! = 1, observe that if U G TMq, then 

7 v m g End(f)^_„^ _ (-l) fe_1 (fc - 1)! I ^_ x ^n* Ma End(£) / 


(4.89) 


V" G 

v u 


2inu k 1 


\\-^ t )~ k d\. 


AM r End ( £ ), 


Moreover, V (; G (A — 2zf t ) k is a linear combination operators of the form 


■ 7 ,r Afr. End ( £ ) 


(4.90) (A - J^) _il (Vy 

, ^End^) 

and X/jj p 

T Mp End ( £ ) 

to prove (14.601) for m! = 1. The case m! > 2 is similar. 


&t){ A - 2,t)~ 12 ■ ■ ■ (X/u MGEnd{£) ^t)( A - 

JZ?t is a differential operator with the same structure as ££t- In particular, 

V f /“ G ' ' ££ t satisfies an estimates analogous to (14.511) . Thus, above arguments can be repeated 

□ 
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Remark 4.11. In the sequel, we will in fact only use Theorem 14. 101 with r = 0,1, but we prefer 
to state it in the general case. 

Proposition 4.12. There are constants C > 0 and M £ N* such that for t £ [0,io] an d A £ T, 
(4.91) || ((A - JZt)- 1 - (A - J%r>|| 0i0 < Ct(l + |A| 2 ) m £ ||^||o,o. 

|a|<3 

Proof. From (14.2911 and (14.491) . for t £ [0,1] and m £ N* we find 
(4-92) |Mkm <C ^ ||Z“ a || 0iTO . 

I Q:| <m 

Moreover, for s, s' with compact support, a Taylor expansion of (14.321) gives 


(4.93) 

Thus, 

(4.94) 


((2S? t -22fo)*y> t ,o <Ct\\s'\\ tA Iloilo,I- 

M<3 


\\(J? t -J?o)s\\t,-i<Ct ll^“a||o, 1 - 

M<3 

Note that 

(4.95) (A - Jgft)" 1 - (A - J^o) -1 = (A - JSf t ) _1 (-2t - -2o)(A - -Sfo) _1 - 

Moreover, Propositions 14.7114.81 and [TTTJ1 still holds for t = 0. Thus, Proposition 14.91 (14.94[) and 

(14.95[) yields to (14.911) . □ 

Theorem 4.13. There exists C > 0 such that for any £ N and uq > 0, there is 

C > 0 such that for any t £ ]0, to]? u> uq and Z , Z' £ Bq 


(4.96) sup (l + l^l + lZ'^l) 7 

\a\,\a'\<m 


Q\a\ + \a\ 


dZ a dZ' a ‘ 


7 (e~ uJft -e~ uSf °) {Z,Z') 


C' 


< Ct( 1 + \Z°\ + \Z'° |) 2 ("+™'+D+ m exp ( 4 C 2 u - z-\z - Z '| 2 ). 


Proof. Let B q = B T * ° B (0,g). Let ||s||| g = Jj Z |< g |s| 2 £xo dv T x(Z), and let J g , Xo = L 2 {B q ,£ B , Xo )- 
If A is a bounded operator on J qyXo , we denote its operator norm by ||4111s,. By (14.611) and (14.911) . 
we know that there is C' > 0 and N,M £ N such that for t £ ]0,1], 

1 / ' u - uA |||(A-j^)' 1 -(A-^o)- 


0 -u5£t _ e ~u£e 0 11 


(4.97) 


69 27r 




<ct J e-uReMfi + |a| 2 ) w (1 + q) N dX < C't{l + q) N . 


Let <f>: T Xo B —> [0,1] be a smooth function with compact support, equal to 1 near 0 and such 
that J T B (f(Z)dvTx{Z) = 1. Let v e]0,1]. By the proof of Theorem 14.101 we see that e~ u ^° 
satisfies an inequality similar to (14.601) . By Theorem 14.101 there exists C > 0 such that for 
\Z\,\Z'\ < q and U,U' £ £ Xo , 

(4.98) \((e~ ujet - e- uJ *°)(Z,Z')U,U') 

- [ - e~ uJ *°) ( Z -W,Z'- W')U , U') 


x 4„_9 rf /v)(j>{W'/v)dv T x{W)dv T x ( W ') 


< Cv(l + q) N \U\\U'\. 
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Moreover, by (14.971) . we have 


(4.99) 


((e- uS?t - e~ u ^°) (Z -W,Z' - W')U , U') 


X in—2d $(W/v)(j)(W'/v)dv T x ( W)dv T x {W') 


<=(1 + 9 )" 


Hence, taking v = 1 1 T 2n d+1 ) we find that there is C > 0 and A'gN such that for any 

2,2'e^ # (0, ? ), 


(4.100) 

In particular, we have 

(4.101) 


(e~ uSft - e~ u ^°)(Z, Z') < C't 1 /( 2 ”- d+1 )(l + g) 


A 






lt=0 


From Theorem 14. 101 (14.10111 and the formula 


(4.102) 

we get (14.9611 . 


G(t) - G(0) = / G'{s)ds, 


\u\\u'\. 

t € ]0, to]: 


□ 


Remark 4.14. As we have estimates on every derivatives of e u ^' t (Z, Z'), we can in fact use the 
same method as in Theorem 14.131 to get an asymptotic expansion at every order of e~ u ^ £t (Z 1 Z'). 


4.3. Computation of the limiting heat kernel. In this section, we will evaluate the limiting 
heat kernel e _u - sf °((0, Z - 1 ), (0, Z ^)) for (0, Z 1 -) e T Xo B and thus obtain Theorem 10.91 

Recall that we have the following splitting of vector bundle over P 1 which is orthogonal for 
both b L and g™ (see (10.251) and (12.191) 1: 

(4.103) TU = T h P © TY ® JTY. 

Note also that by (10.121) and (10.261) . we have 

(4.104) = 

and thus — JJ preserves both TY and JTY on P. In particular, on P , J intertwines TY and 
JTY , and is invertible on TY © JTY because g™ and b L are definite positive on this bundle. 
Thus, 

(4.105) J 2 TF = TY , JXT = JTY , J T H P = JT H P = T H P. 

Thus, J induces naturally J q € End(TMc), and we see with (14.31) that ( JTY)b\m g is the 
orthogonal complement of TMq in TB. We will identify the normal bundle Nq of Mq in B with 
{3TY) b \ Mg . From this fact and (14.1051) . we know that for U, V £ T Xo B , 

(4.106) u{U H , V H ) = ujg{P™ G U, P™ G V). 

From the above discussion, we can diagonalize J on ( T H P )( 1 ’°) and {TY © JTY)( 1,0 \ and we 
thus can get orthonormal basis and of Txl’°^M q and Ng, Xq = ( 3TY)b, Xo C TB 

respectively such that in these basis 

Mr diag ( a l ’ ‘ ' ‘ ’ a n—d)i 

j 2 kc,x 0 =-^diag(a^ 2 ,...,a^’ 2 ), 
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where a° £ Randaj- £ R* are the respective eigenvalues oi —2y/—lnJ\( T Hp^i.o) and —2y/—lTrJ\( T Y<&jTY)<- 1 
Let {w°' : ’}™Zi and {e J - ,l }f =1 be their dual basis. We also set 


(4.108) 




+ wj) and e° = 


V2 




Then {e?}?"i 2d is an orthonormal basis of T Xo Mg- 

From now on, we will use the coordinates in Section [Til induced by the above basis as in (EH). 
We denote by Z° = (Z ®,..., Z^ n _ 2d ) an d -Z' J ~ = {%!> ■ ■ ■ ; %d) the elements in T Xo Mg and 
Ng,x o- Then Z £ T Xo B can be decomposed as Z = (Z° 1 Z ± ). We will also use the complex 
coordinates z° = ( 2 °,..., 2 °_ d ), so that 


(4.109) 


Z° = 2°+ 2°, 

= ™1 
j 

e o -A + A 

2J - 1 dz? + 8% 


V2 


&z°/ 


d 


"2 1 


3 


d 


)■ 


When we consider 2 ° or 2 ° as vector fields, we identify them with 2°Tpj a nd 2 °^=^. Note 
that 


(4.110) 

Set 

(4.111) 

and recall that 

(4.112) 


d 

2 

d 

d -°s 


^1 


2 ~\ and l*T = l*T = ^T- 


2n—2d 


x = - E ( v o,e?) 2 - 


n—d 

£4 

l=i 


^ - V ((V 6 _l ) 2 - la^^l 2 ) -Va! 


i=i 


/ y i 

i=i 


As in [H (3.11) and (3.13)], we can show using (12.151) . (14.271) and (14.1061) . that 


(4.113) 


R x „ (U,V) = -2nV^l(JP™ G U,P™ G V), 
■Zb = ££ + - 2w d (xo), 


Thus, 

(4.114) e~ uJ *°{Z,Z') = e- u ^(Z 0 ,Z ,0 )e~ u - s( ’ ± (Z- L ,Z , - L )e 2uuid(xo) . 


Moreover, using (14.1071) . (14. 11 11) . (14.1131) and the formula for the heat kernel of a harmonic 
oscillator (see [151 (E.2.4), (E.2.5)] for instance), we find (with the convention of Theorem 10.91) : 


(4.115) 


e" u ^(0,0) 


1 _ det(R^) 

(2n) n ~ d det (1 - exp(—2ui?^ G )) ' 


We can now prove Theorem 10.91 We fix u > 0. 
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Let s G £ Xo ). Then by (14.261) and (14.271) 

e~ u ^s(Z) = SrV /2 e-^<°’ 2 ^V 1/2 S t (Z) 

(4.116) = n(tZ) [ e~p^ D p°’ 2 ^~ 1 (tZ, Z')(S t s)(Z')K l/2 (Z')dv T x(Z') 

J K 2n-d 

= p- n+ dl 2 n(tZ) [ e-r* D r°' 2 *~\tZ,tZ")s(Z")K 1 /‘ 2 (tZ")dVTx(Z"), 

JR 2n-d 


which yields to 

(4.117) e~ uS£t (Z, Z') = p- n+d / 2 e-p 9D p 0 ’ 2 ^~\tZ,tZ')K 1/2 (tZ)K- ll2 {tZ'). 


On the other hand, for s G ^ c °°(i?o, (Eo, p ).b 0 ) and v G M 0 , 


( — “$d m o> 2 $ 

e p p 


's) (7r(u)) = ( 


I _« JJ M o . 2 _ 

= $e p p 4> 


(4.118) 


thus we find 


1 s) (tt(v)) 

= h(v) f e~ pDp ° ( v,v')h~ 1 {v')s(v')dvM 0 {v') 
Jm 0 

= h(v) f e~ pDp °’ (' v,y')h(y')s{y')dv Bo {y '), 

J Bo 


(4.119) h(v)h(v')[P G e pDp ° P G )(v,v') = e p 




(7r(u),7r(u / ))- 


Let v=(g,Z)eU ~ G x i? Tx o B (0, e). We suppose that in the decomposition Z = Z° + Z- 1 -, 
we have Z 0 = 0. Then from Corollary 14.21 Theorem 14. 141 (14.1171) . and (14.1191) . we find that for 
any to, to' G N, there exists G > 0 (independent of i^) such 


(4.120) p- n+d/2 h{v)h(v)(P G e- pDp P G ){v,v) - kT 1 (Z^e-^ 0 (y/pZ x , y/pZ^) 


V m '(M G ) 

< Cp- 1 f 2 [\ + y /r\z ± \)~ m . 


Now, for v G U, we write as in the Introduction of this paper v = (y, Z ± ) with y G P and 
Z 1 - G Np/u iV . Let x = 7T (y) G M g . Then we do the procedure of Sections 14.11 and ITTH with 
xq = x and yo = y. Then Theorem 10.91 follows from (14.1141) . (14.1151) and (14.1201) applied to 
z = (0, Z - 1 ) G T X0 B = T X0 M g © N GiXo . 


5. Proof of the inequalities 

In this Section, we prove our main results: Theorems 10.31 and 10.51 In Section 15.11 we prove 
Theorem 10.71 and. as a consequence, we obtain the G-invariant holomorphic Morse inequalities in 
the case of a free G-action on P. Then, we explain in Section 15.21 how to modify the arguments 
in Sections [I] and 15.11 to get our inequalities under Assumption 10.11 in full generality. Finally, 
in Section 15.31 we apply Theorem 10.51 to get estimates on the other isotypic components of the 
cohomology H'(M, L p © E). 

5.1. Proof of Theorem 10.31 when G acts freely on P. We assume in this Section that G 
acts freely on P and U. We keep here the notations of Sections 0] 

In this section, we will first prove Theorem 10.71 and then show how to use it in conjunction 
with the convergence of the heat kernel of the rescaled operator to get Theorem l0.3l The method 
is inspired by [2] (see also [151 Sect. 1.7]). 

For 0 < q < n, set 

(5.1) 


b p ’ G = dim H q {M,L p ® E) G . 
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By Hodge theory, there is a G-equivariant isomorphism H*(M, L p ® E) ~ ker .D^, and in partic¬ 
ular we get for the invariant part: 

(5.2) H*(M, L p ® Ef ~ (kerD^G and 5 p,G = dim (ker^)G. 

We begin by proving Theorem 10.71 


Proof of Theorem \0.7\ If A is an eigenvalue of Dp acting on Q 0,J (M. L p ® E ) G , we denote by F x 
the corresponding finite-dimensional eigenspace. As 8 LP ® E and B LP ® E ’* act on L P ®E) G 

and commute with Dp, we deduce that 

(5.3) B lP ® e {F x ) C F/ +1 and d L ”® E ’*(F x ) C F x _ x . 

As a consequence, we have a complexe 


F x 

r o 


qLP®L 


F x 


qL,p®i 


(5.4) 0 

If A = 0, we have Fl- ~ H q {M,L p ® F) G by (15.21) . 
Indeed, if 8 LP ® E s = 0 and s £ F x , then 



If A > 0, then the complex (15.41) is exact. 


(5.5) s = X~ 1 DpS = x- 1 B LP ® E d LP ® E ’*s g Im(i9 LP ® B ). 


In particular, we get for A > 0 

<? 

(5.6) ^(-l) 9 "-?' dim F j X = dim (d LP ® E (F x )) > 0, 

3=0 


with equality if q = n. 

Now, 

(5.7) Try [P G e~ p d pP g \ = ^’ G + ^ e“ p A dim F/. 

A>0 

Thus, (15.61) and (15.71) entail (10.201) . 

Note that this proof does not depend on the metric we chose on TM , so we get (10.201) in 
general. □ 


We denote by Tr A o,,j the trace on A °’ q (T*AI) ® L p ® E or A°’ q (T*M). We know that 

(5.8) Tr q [P G e~p D pP G \ = [ Tr A o,« (P G e~ p D pP g ) (y, v) dv M (v). 

Jm L 

With Theorem 10.81 and (14.231) . we in fact have 

(5.9) Ti- q [P G e~p D pP G ] = ( Tr A o,„ (P G e~p d pP g ) (v, v) dv M {v) + 


By Theorems 10.71 and 10.91 (15.91) . and using the change of variable Z E -s-A , we deduce 

that for every u > 0, 


<? 

(5.10) p- n+d Y^-l) q - j tf' G < 

3=0 


rk (E) 

( 27r) n ~ d 


xGMg, \Z- L \< y /pe 


det (R Eg ) Ej=o(-l) g - J ' ^A°.i [e 2u ^\ ^ 
det (l — exp(— 2uRx G )) 


{Z E , Z ± )dv T B{x, Z E ) 


+ o(l). 
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For u > 0, set 
(5.11) 


/(m) = 


Then there is c > 0 such that for u > 1, f(u) > c, and f(u) - > ±1. By (10.291) and Mehler’s 

u —^ioo 


tanh(2u) sinh(2u) 
f(u ) > c, and f(u 
formula (see H33 Thm. E.1.4] for instance), we know that 

d I i 

exp{— ajf(uaj)Zj’ 2 } 


(5.12) e~ u ^ (Z ± ,Z ± ) = ]J, 

i= 1 


r (i — 


0 —4 ua 1 


Thus, as aj f{uaj) > 0, 

f ''~ uSe *(Z- L , Z ± )dv Nc , tX (Z^) = f e 

Jw d 


(5.13) 


'I Z-H<Vpe 


{ Z ± ,Z ± )dv NG jZ ± )+0{p- ao ) 


1 


v /( ua i L )( i-e 


Let { wj} be a local orthonormal frame of such that R L °wj = aj wj (see (14.1071) 1. 

Its dual frame is denoted by {ic 0 ’- 7 }. Then 


(5.14) 


WG,d = ^ ^2 aj w°’ J A i w o. 
3=1 


orthonormal frame of (TY ® JTY'j 1,0 ) such that R L wj = aj wj (see Section rot . Its dual 


We again denote by wj the horizontal lift of wj in T H P. In the same way, let {wj-} be a local 
orthonormal frame of {TY ® JTY)( 1,0 ^ such that R L wj = aj-wj 
frame is denoted by {'U)- L ’- 7 }. Then 

(5.15) 


n—d d 

Wd = - ^2 aj w° J A i w 0 - y, 
3=1 3 3=1 


aj w^-'i A i w ±. 

J 7 


Thus, writing {wj} = {wj,wj} and {aj} = {aj , aj-}, we get 


(5.16) 

and 

(5.17) 


e 2uuid = j + J2(e~ 2ua i - l)w 4 A i Wj 


Tr A o, 9 [e 2uuJd ] = ^2 exp ( - 2u ^ t 


) ■ 


jl<"<jq fc=l 

In particular, there exist C > 0 such that for x £ Mg , u > 1 and 0 < q < n, 


(5.18) 


det(R£ a )Tr A o. q [e 2vu *W] -q 


1 


det (l — exp(— 2uRj G j) ~~ y f(uaj){l — e 4ua t ) 


< C. 


On the other hand the signature of b L on JTY is the same as on TY (i.e., (r,d — r)), so by 
Lemma 12.31 and (12.151) , (12.191) and (12.321) we have for 0 < q < n 


( 5 . 19 ) 


7 t(P D M{qj) = Mc(q — r) 
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where M{< q ) is define in an analogue way as Mq(< q) in the introduction. Thus, by (15.171) 
and (15.191) . 

( 5 . 20 ) lim ^)T IA .,.[eW->l A / 1 . 

-U-S -+00 det (l — exp(— 2uRx G )) "■ y f(uaf){l — e 4ua i ) 

= l MG ( q -r){x){-l) q ~ r det (R Lg ), 

where the function I 5 takes the value 1 on S and 0 elsewhere. 

Using (15.101) . (15.131) . (15.181) . (15.201) and dominated convergence as u —> + 00 , we find 


limsupp-"+ d X!(-l) , " i ^ G ^ 7^11 

p^+oo “ (27 T) n d Hr 


1 


f(ua p )( 1 — e 4ua i ) 


(5.21) 


det(R pG ) ELo(- 1 ) 9 ”' Tr A°- [e 2 ““ G ’ d(x) ] 


/ Mg 


det 


' M G (<q—r) 


det (l — exp (—2 uR x G )) 
R B °' 


dv Ma (a;) 


27T 


')■ 


< (-l) 9 ” r / 

J A 

Finally, note that 

(5.22) det (J^—^cLvm g (x) = /(n-d)\ 

Then (15.211) and (15.221) entail Theorem 10.31 


UJ r 


%—d 


[n — d)\ 


5.2. The case of a locally free action. In this section, we prove Theorem 10. 31 under Assump¬ 
tion EH In particular, the action of G on P and U is only locally free, and thus Mq and B 
are orbifolds. The proof relies on a similar method as the case of a free G-action, but the main 
difference is that we need to work off-diagonal to get uniform estimates near the orbifold singu¬ 
larities. We explain below how to adapt the arguments in Sections l4l and IOI to get the general 
result. 

Recall that G° = {g € G : g ■ x = ar for any x £ M}. Then G° is a finite normal subgroup of 
G and the quotient G/G° acts effectively on M. 

It is a well-known fact that if <fr: ( M,g ™) — > (M,g™) is an isometry and x £ M is a 
point such that <f>(x) = x and d(j> x = Id-r^M then </> = Idjtf. In particular, suppose that g £ G 
satisfies g\p = Idp. Then we have for x £ P: gx = x, dg x \T x p = Id t x p and g preserves J so 
dg x \jr x p = IdjT x p- As TP + JTP = TM , we deduce that g acts as the identity on M. Thus, 

(5.23) G° = {g £ G : g ■ x = x for any x £ P}. 

Recall that the function h defined in Ol is smooth only on the regular part of B and we 
have denoted by h its smooth extension from the regular part of B to B. 

First, we need to modify Section fTTTl as follows. 

Recall that TM is endowed with a metric g™ satisfying (10.251) . We identify the normal 
bundle N of P in U to the orthogonal complement of TP. By (10.241) and (10.251) , this means that 
N is identified with JTY. By (10.241) and (12.171) . we have in particular T H U = T H P © N. 

Let g TY , g T u be the restriction of g™ on TY, T H U. Let g TB (resp. g™ G ) be the metric 
on TB (resp. TMq) induced by g rHu (resp. g THp ). 

Here, unlike in Section El we will not work on the quotient B but directly on M. Let V 2 B 
be the Levi-Civita connection on (TB, g TB ). Let P N and P T p be the orthogonal projections 
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from T H U\p to N and T H P respectively. Set 

X7 tHu = n*X/ TB , X7 n = P n (X7 tHu \ p )P n , 

, i " 1 ' V T H P = P T s P(yT*U\p)pT H P t OyT H U = 0 yT H P 


Fix y 0 £ P. For V £ T H U (resp. T H P), we define t x t = exp yg U {tV) £ U (resp. 
exp^ o p {tV) £ P) the curve such that Xq = yo, ±o = V, x £ T H U and Vj u x = 0 (resp. 
x £ T h P and X7 pHp x = 0). For W £ T H P small and V £ N Vo , let TwV be the parallel 
transport of V with respect to V N along to curve t £ [0,1] i-A exp^ o p (tW). 

As in Section EH we identify B Ty o c/ (0,e) to a subset of U as follows: for Z £ B Ty o u ( 0, e), 
we decompose Z as Z = Z° + Z p with Z° £ T P o P and Z p £ N yo , and then we identify Z with 

exp S l Hp (z°) {TzoZ±) - 

Moreover, if G yo = {g £ G : gyo = yo} is the stabilizer of yo and g £ G yo , we can decompose 
T p P as 

(5-25) T*P = (T” o Py®Af y 0ifl , 

where (T p P) 9 is the fixed point-set of g in T p P = T yo P fl JT yo P and Af yo , g is its orthogonal 
complement. Hence we get, for each g £ G yo , a decomposition of the coordinate Z° as Z° = 
Zi g + Z® g with Zi g £ (T p P) 9 and Z^ g £ A/" yo , g . Note that rk(J\f y0yg ) = 0 if and only if g £ G°. 

Observe that U ~ G ■ B Ty o u (0, e) = G x a vo B Ty o u (0, e) is a G-neighborhood of the orbit G ■ yo 
and (B Ty o u (0, e), G yo ) gives local chart on B. 

As the constructions in Section rrn are G yo -equivariant, we can extend in the same way the 
geometric objects from G *G yo B Ty o u ( 0,e) to 

(5.26) M 0 :=Gx Gyo R 2n - d , 

where R 2n-d ~ T ya U. Note that Lemma [4.11 and Corollary 14.21 still hold, because do not work 
on the quotient to get them: we only use finite propagation speed of the wave equation on M. 
Set 


B 0 = M 0 /G = R 2n ~ d /G yo , 

M 0 = GxR 2n ~ d , B 0 = M 0 /G = R 2n ~ d . 


Then we have a covering M 0 —> M 0 (resp. B 0 —> B 0 ) which gives a (global) orbifold chart on 
Mo (resp. B 0 ). We can then extend the geometric objects from M 0 to Mo- We will add a hat to 
denote the corresponding objects on Bq or Mq. In particular, we have a Dirac operator D y Ia on 
Mo corresponding to D^° in Section EH 

Let 7 tq-Gx R. 2n_d — > R 2n-d be the projection on the second factor. As in (11.101) . we define 
(5.28) $ = hn G : tf°°{G x R 2n ~ d , E 0 , P ) G -A ^(R 2n ~ d , {Eo. P ) So )- 

We also denote by $ the map induced from < ^°°(Mo,Eo,p) G to c to (x (Bo, (E 0 , p )b 0 )- 

Let g™° be defined as in (14.181) and let g T M ° be the metric on M 2 ” _d induced by g™°, 
with corresponding Riemannian volume on ( R 2n ~ d ,g T M °) denoted by dv T H M0 . 

Let e~ u ® D p ° ® be the heat kernel of the operator <f>D^ fo,2, I> on Bo and e~ u ® Dy ° ®(Z,Z') 
(Z^Z 1 £ Bo) be its smooth kernel with respect to dvpH M (Z 1 ). Concerning heat kernels on 






G-INVARIANT HOLOMORPHIC MORSE INEQUALITIES 


37 


orbifolds, we refer the reader to P~T1 Sect. 2.1]. Then we have for v = [g,Z] and v' = \g',Z'] in 
M 0 , 


(5.29) 


h(v)h(v')(PGe pDp PG)(y,v') = e p 

1 




Mn.22-1 




|G “' 


^ ^ ( 1 \ — — D „ 0 ’ ^ <J> / —1 ry ryl \ 

(9, l)-e p p (g Z,Z), 


where |G°| is the cardinal of G°. Indeed, the first equality in (15.291) is analogous to (14.1191) . and 
the second from a similar computation as in [B] (5.19)] or T5] (5.4.17)]. 

Note that our trivialization of the restriction of L (resp. E) on B T v o u (0,e) is not G yo -invariant, 
except if G Vo acts trivially on L Vo (resp. E yo ). More precisely, let Mq,o = R 2n_2d x {0} C B 0 
and for g £ G yo , let Mq 0 be the fixed point-set of g in Mg, o- Then the action of g on L\^ g 

is the multiplication by e l6g and 8 g is locally constant on Mq q . Likewise, the action of g on 
E\^ g is given by gE £ < £°°{Mq 0 ,End(.E)) which is parallel with respect to S7 E . 

Now, as we work on B 0 and M 0 , we can apply the results of Sections 14.1114.31 to the operator 
We will use the same notation as in these sections, and add a subscript to indicate 
the base-point (e.g., k x , JZb >x , ••■)• By Theorem 14.131 and (14.1171) . we obtain for g £ G yo and 
u > 0 fixed 


(5.30) 


p ~n+dl2 e -^D^$ {g _ lzz) 

- (■sfvg-\z %g + Z E ), ^p{Z 2 , g + Z E )) 

v AT / 


K m '{M G ) 


<Cp 1/2 (l + y/p\Z 2 ,g\) (l + Jp\Z ± \) m exp(-Cp inf |h l Z~Z\ 2 ). 

h£G vr , 


On the other hand, note that there is p > 0 such that for g £ G yo , \g X Z — Z| 2 > p\Z- 2 , g \ 2 , so 


(5.31) 


p -n+d/2 e -^ D ^$ { g-l Z 'Z) 

(- Vpg-\Z 2>g + Z E ),Jp{Z 2 , g + Z E )) 


v z lig 


<€ m '(M G ) 

< Cp- 1/2 (1 + s /p\Z- L \)~ m exp ( - C'p\Z 2 , g \ 2 ). 


We can now prove Theorem 10.51 First, observe that Theorem 10.71 is still true here because we 
work on M to prove it in Section 15. II Thus, we can use a similar approach to prove Theorem l0.5l 
as in Section I5J1 

Note that the estimate m still holds. Consider now a G-invariant function ip £ C £°°(M) 
such that the induced function (again denoted by ip) on B is compactly supported in a small 
neighborhood of Xq £ Mq- 
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Similarly to (14.261) . we denote by dv T H V the Riemannian volume of (T^U, g Ty ° U ). Then, as 
in (15.101) . (15.311) and dominated convergence imply that 


(5.32) p 


-n-\-d 


ip(v)Tr q (P G e p d p °’ P G )(v,v) dv M (v) = 


E 


p 


i r ^(-NyQ,g)/2 


|GVG°||G°| ^ (2tt)- 


i—d 


' Mp,z. 


1,9 


+ 


£2 ,g 

Vp 


Tr„ 


(9, 1) 


det Je 2uud( - Zl ^ 


det (l — exp(— 2 g )) 


xe uJ ^ Zl ^(g 1 {Z 2 , g + Z J -),Z 2 , g + Z- 1 ) ®Id E 


dvTHjj(Z) + o(l), 


where A(p,e) = {Z £ B 0 : |^i, g | < e, \Z 2 ^ g \ < e^/p, \Z ± \ < e^/p}. In particular, in (15.321) . every 
term involving a g such that rk(7V y0jS ) > 0, i.e., g ^ G°, disappears when we look at the leading 
term in p. 

Thus, we now consider g £ G°. The action of g on M and A 0 , *(T*M) is trivial, so we have 


(5.33) Tr, 


' x det{R^)e 2uu Az°) 

1 det (l — exp(—)) ^ Z ' 2 ) ® Idi 

= e „», de.(i%?) 1^.. [e^] ^ ' 8 gE{zy 


det (l — exp(— 2uR^q)) 
Using (15.3211 and (15.331) . we get as in (15. 13D - (15.2II) : 


lim sup p 

p —^ Too 


(5.34) 


~ n+d ' Tp{v)Tr q (P G e p d pP g )(v,v) dv M {v) 

1 1 


w 


< 


(2tt y~ d |G°I 


Eli 

g eG° i =1 


1 


f{uaf){ 1 — e 4ua i ) 


J M a 
< (- 1) 9 


V>(x) 


det(P^) El=o(-l) 9 ~ J ' TrAQ,. [e 2 ^-^] ^ £ 


e lp 9 Tr [g_E(a:)]d-UM G (a;) 


det (l — exp(— 2uRx G )) 

~ r 1 ip(x) det (^j-) |^7 ( eW(>3 TrE i 9 E(x)]j dv Mc (x) 


' M G (<q—r) 


<?eG° 


= (_ 1)9 r dim(L p ® E) g f tp(x) det (^—^\dvM a {x). 

JM G {<q-r) V 27T / 


Finally, we take some functions ipk as ip above and such that V’fc = 1 in a neighborhood 
of M g in B and we apply (15.341) for those ipk . We get Theorem 10.51 bv taking the sum over k of 
the obtained estimates and using Theorem 10.71 and (15.91) . 


5.3. The other isotypic components of the cohomology. In this subsection, we show 
how to use Theorem 10.51 to get estimates on the other isotypic components of the cohomology 
H*(M,LP®E). 

Let V 7 be the finite dimensional irreducible representation of G with highest weight 7 . 
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For a representation F of G , we denote by Fj its isotopic component associated with 7 . Then 

we have 

H m (M, L p ® E)-y = V 7 <g> Hom G (V 7 , H*(M, L p ® £')) 

(5.35) = V 7 ® (H'tM.LP ®E)®V*) G 

= V 7 <g> H* (M, L p ®E® V^) G , 

where V* is viewed as a trivial bundle over M. 

By Theorem 10.51 applied replacing E by E ( 8 ) V* and (15.3511 we have as p —> + 00 , 

1 

(5.36) ^(-1) 9 “ J ' dim iJ J (M, 17 <g>£) 7 

3 =0 

^n—d r 

< dim V 7 dim(L p ® E ® V!) G / / (-l)«- r wg- d + o(p n - d ), 

7 (n-^)!iM G (< 3 -r) 

with equality for q = n. 

In particular, we get the weak inequalities 

(5.37) dim H q {M,L p ® £) 7 

< dim V 7 dim(L p 0 £ ® V*) G -- / (-l) 9 - r wS- d + o(p n " d ). 

(»-Viif c M 
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